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Abstract 

Recent  experiaents  enphasize  the  need  for  further 
research  to  determine  how  to  design  and  use  computer-based 
instruction  (CBI)  with  aaxiaua  effectiveness.  This  research 
addresses  that  need  by  investigating  the  differences  caused 
by  top-down  or  deductive  and  bottom-up  or  inductive 
curriculum  (lesson)  structuring  in  self-paced  CBI.  Three 
research  variables  were  measured  to  investigate  these 
differences:  student  learning  (measured  by  performance 

testing),  CBI  course  completion  time,  and  student  attitude 
toward  the  learning  experience.  Computer  programs,  written 
for  each  curriculum  structure  using  BASIC  programming 
language,  were  administered  to  students  at  the  Air  Force 
Institute  of  Technology  in  post-test  randomized  design 
experiments.  Descriptive  statistics  and  nonpar ametric  tests 
were  used  to  analyze  these  results.  The  nonparametric  tests 
showed  that  the  data  was  not  statistically  significant  (at 
0.1)  for  any  of  the  three  variables.  This  key  finding 
indicated  that  CBI  educators  can  use  either  curriculum 
structure  with  almost  equal  effect.  In  addition,  the 
differences  which  resulted  were  used  to  develop  scenarios 
where  one  variable  was  seen  as  the  primary  objective  with 
the  other  two  of  lesser  (but  still  essential)  importance. 
Such  an  analysis  offers  guidance  to  CBI  educators  seeking 
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the  structure  which  aaxiaizes  their  particular  learning 
objective . 
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ANALYSIS  OF  THE  EFFECT  OF  CURRICULUM  STRUCTURE 


ON  STUDENT  PERFORMANCE  MEASURES  IN  A 
COMPUTER-BASED  INSTRUCTIONAL  ENVIRONMENT 

I .  Introduction  to  the  Study 


Background 

Recent  studies  have  shown  that  computer-based 
instruction  (CBI)  has  potential  to  help  the  Department  of 
Defense  deliver  cost-effective  education  and  training 
(4:18-19;  6:33-34;  16).  One  1989  study  conducted  at  the 
Air  Force  Institute  of  Technology  found  that  CBI  produced  a 
7X  improvement  in  learning  and  a  67%  reduction  in  time  when 
compared  to  the  results  of  teaching  the  same  material  by 
traditional  classroom  methods  (21:57-58).  These  and  similar 
experimental  findings  underscore  the  importance  of  further 
research  to  determine  how  to  design  and  use  CBI  with  maximum 
effectiveness. 

Specific  Ig.g.yg. 

Whether  instruction  is  delivered  in  a  traditional 
classroom  or  by  CBI,  several  elements  interact  to  influence 
the  learning  process.  As  labeled  by  Gowin  (12:24-25),  these 
elements  are: 

eo vernance— the  social  context  by  which  the 
educating  process  occurs. 
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curriculua  content- -the  content  of  a  lesson. 


curriculum  structure- -the  structure  of  a  lesson, 
ts achcr--the  instrument  that  delivers  the 
instruction. 

student- -the  person  receiving  the  instruction. 

When  these  elements  are  viewed  in  terms  of  Air  Force 
education  and  training,  some  of  them  act  as  constants  while 
others  are  variables  in  the  learning  situation.  For 
example,  Air  Force  regulations  specify  the  types  of 
knowledge  that  individuals  must  possess  : n  order  to  perform 
specific  jobs.  Said  another  way,  the  content  of  each  Air 
Force  curriculum  is  a  constant  specified  by  Air  Force  needs. 
In  addition,  the  fact  that  the  Air  Force  provides  education 
or  training  to  supply  the  knowledge  required  by  its  members 
and  civilian  employees  according  to  Air  Force  guidelines 
means  that  the  governance  or  "social  context"  of  the 
instruction  is  also  a  constant. 

When  CBI  is  used,  the  teacher  is  another  constant. 

Unlike  traditional  classrooms,  where  a  teacher’s  personality 
and  style  of  teaching  can  assist  or  impede  learning,  CBI 
instruction  exposes  each  student  to  the  course  content 
through  the  medium  of  words  or  graphic  images  displayed  on  a 
television  monitor  (in  some  cases  enhanced  by  computer 
generated  sound.)  Thus,  the  delivery  from  classroom  to 
classroom  is  unaffected  by  teacher  style  or  personality. 
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When  governance,  teacher,  and  curriculum  content  are 
held  constant,  the  other  two  elements--the  curriculum 
structure  and  the  student--caergc  as  key  variables  in 
potential  CBI  instruction  within  the  Air  Force.  The 
research  project  described  in  this  report  exaained  the 
interactions  of  these  two  variables.  Specifically,  it 
studied  the  learning  effects  produced  by  two  different 
content  structures  on  two  randoaly  assigned  groups  of 
students  . 

Research  Question 

The  priaary  question  addressed  in  this  research  can  be 
stated  as  follows: 

If  the  saae  body  of  content  is  arranged  in  a  top- 
down  (deductive)  structure  and  a  bottoa-up  (inductive) 
structure  and  presented  to  students  by  coaputer-based 
Instruction,  what  (if  any)  differences  occur  in  student 
learning  (aeasured  by  performance  testing),  in  course 
completion  time,  and  in  student  attitude  toward  the 
learning  experience? 

Pcf  sjL  Key  I  eras 

The  following  definitions  further  explain  the  research 
project : 

Top-down  (Deductive )  Structure :  structure  which 
presents  material  such  that  a  general  concept  or  idea  is 
presented  and  subsequently  broken  down  into  lower  level 
constructs  which  can  detail,  explain,  identify,  or 
demonstrate  the  original  concept. 
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Bottoa-uP  ( Inductive )  Structure ;  structure  which  is 


essentially  the  inverse  of  top-down,  where  lower  level 
details  or  constructs  are  presented  first  and  then  sunned 
(or  lead)  to  a  generalization. 

Per f onance  Testine :  the  use  of  objective  (aultiple- 
choice)  test  questions  to  aeasure  student  learning  froo  the 
CBI  experience. 

Course  Completion  Time :  that  amount  of  time  measured 
from  the  point  when  the  student  starts  the  CBI  to  the 
completion  of  the  CBI. 

Learner  Attitude :  an  indication  of  whether  students 
like  or  do  not  like  the  content  structure  of  the  CBI 
presentation . 


4 


ii .  Review  ai.  Literature 


This  chapter  describes  the  theoretical  literature  that 
contributed  to  the  research  described  in  this  report. 
Additional  literature  that  supports  the  study's  methodology 
is  discussed  in  Chapter  III. 

Top-down  and  Bottom-uP  Structuring 

As  defined  in  Chapter  I,  top-down  structure  requires 
deductive  reasoning  processes,  whereas  bottoa-up  structure 
requires  inductive  reasoning.  The  lore  formal  terms 
"deduction"  and  "induction"  describe  the  learning  process  in 
the  student's  mind,  while  the  less  formal  synonyms  "top- 
down"  and  "bottom-up"  describe  the  way  a  curriculum  planner 
views  the  structure.  The  more  formal  terms  are  customary  in 
the  literature  reviewed  here. 

In  the  Handbook  of  Research  on  Training .  Henderson 
speaks  primarily  of  inductive  and  deductive  processes  in 
structuring  material  for  an  educational  application.  Top- 
down  structure,  using  his  terminology,  is  referred  to  as 
"tell-and-do"  structure,  and  "bottom-up"  structure  is 
referred  to  as  a  "heuristic"  method.  According  to 
Henderson,  applying  the  top-down  or  deductive  structure 
requires  the  following  steps: 

1.  Explicitly  telling  the  student  the  item  or  concept 
to  be  learned  (10:1014). 
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2.  "Clarifying,  if  necessary,  the  leaning  of  the 
description  used  to  express  the  knowledge"  (10:1014). 

3.  Justifying  or  asserting  the  importance  of  the  item 
to  help  student  motivation  in  mastering  the  concept 
(10:1014) . 

4.  "Clinching  the  understanding  of  the  item  (this  is 
often  done  by  having  the  student  work  problems  based  on 
the  knowledge  being  taught"  (10:1014). 

5.  "Making  the  transition  to  the  next  item  being 
taught"  (10:1014). 

The  bottom-up  structure  uses  a  different  structure  of 
content  for  presenting  a  concept.  Henderson  describes  the 
steps  in  the  following  manner: 

1.  Presenting  instances  [or  examples]  of  the  item  or 
concept  to  be  taught  in  order  to  enable  the  student  to 
form  hypotheses  (10:1014). 

2.  "Presenting  evidence,  perhaps  even  more  instances, 
serving  either  to  confirm  or  disconfirm  the  various 
hypotheses  students  state  or  appear  to  acting  on" 
(10:1014)  . 

3.  "Stating  or  having  a  student  state  the  item  of 
knowledge  [the  concept,  rule,  or  generalisation]  which 
is  a  warranted  inference  from  Steps  1  and  2"  (10:1014). 

In  a  collection  of  research  efforts  concerned  with  how 
people  organize  their  knowledge  in  the  process  of 
understanding  and  retaining  new  knowledge,  Abelson  and  Black 
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identify  top-down  processing  as  one  of  the  three  sain 
propositions  on  which  schena  theories  are  based  (11:4).  A 
schema,  in  their  terms,  is  a  knowledge  structure,  and  their 
central  hypothesis  is  that  knowledge  is  organized  in  chunks 
or  packages  in  an  individual’s  mind.  They  define  deductive 
or  top-down  structures  as  those  in  which  the  meaning  lies 
above  the  text  or  explanation  (with  implication  of  moving 
down  to  assimilate  the  text).  On  the  other  hand,  for 
inductive  or  bottom-up  structuring,  the  meaning  lies  in  the 
text  (examples  provided  first),  spreading  upward  to  higher 
level  generalizations  (11:4). 

Orwig,  another  author  writing  in  this  area,  recommends 
similar  approaches  for  applications  using  computerized 
instruction  (19:43-44).  The  deductive  method,  which  Orwig 
calls  "RULEG"  ("rule  before  example”),  prescribes  that  a 
rule  be  taught  first,  followed  by  examples.  This  is  the 
normal  approach  in  top-down  structuring. 

Orwig  uses  the  acronym  "EGRULE"  ("example  before  rule”) 
to  describe  bottom-up  or  inductive  structure.  In  EGRULE, 
examples  are  presented  first,  followed  by  the  rules  or 
concepts  which  the  examples  illustrate. 

Orwig  suggests  the  EGRULE  structure  should  be  used  when 
the  student  is  encountering  new  material.  On  the  other 
hand,  if  the  student  is  working  with  familiar  material,  the 
RULEG  structure  is,  in  Orwig's  view,  more  effective  than 
EGRULE  (19:43-44). 
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Orwig's  discussion  suggests  that  the  criterion  which 
affects  the  choice  of  one  or  the  other  curriculum  structure 
is  whether  or  not  the  student  has  prior  knowledge  about 
material  to  be  learned.  This  view  is  a  popular  one, 
promoted  by  such  leading  educators  as  David  Ausebel,  who 
once  said,  "The  single  most  important  factor  influencing 
learning  is  what  the  learner  already  knows"  (18:40). 

However,  the  literature  indicates  that  other  variables 
besides  past  knowledge  may  affect  how  individuals  respond  to 
either  of  the  two  structures.  One  of  those  variables  is  the 
way  each  learner's  mind  processes  information.  The  field 
of  cognitive  science  has  explored  this  theory,  which  is 
discussed  in  the  following  paragraph. 

Cognitive  scientists,  in  general,  view  the  human  mind  as 
a  complex  system  that  receives,  stores,  transfers,  and 
transmits  Information  (22:1).  An  important  corollary 
assumption  to  this  view  is  that  a  basic  science  of 
information  processing  is  possible  (22:5).  This  has  led 
cognitive  scientists  to  perform  research  in  hopes  of 
discovering  general  (explanatory)  principles  of  information 
processing  in  humans.  Through  these  efforts,  however,  they 
have  recognized  that  the  assumption  that  a  general  model  is 
possible  directly  conflicts  with  the  tremendous  variability 
known  to  exist  in  human  thought  (22:5).  Such  evidence, 
which  suggests  that  no  two  minds  process  the  same  way,  has 
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raised  doubt  as  to  whether  principles  of  huaan  information 
processing  can  be  found  to  hold  across  all  cultures  (22:5). 

Types  and  Characteristics  q_L  Effective  CBI  Programs 

The  vocabulary  used  to  describe  instruction  "delivered" 
by  coaputers  is  not  standardized  in  the  literature.  Some 
authors  use  the  acronym  CA1  to  mean  "computer  aided” 
instruction  or  "computer  assisted"  instruction.  Others  use 
the  acronym  CBI  (computer-based  instruction)  to  signify  any 
instruction  that  is  delivered  by  means  of  a  computer.  For 
this  research,  the  acronym  CBI  will  be  used  throughout  the 
following  discussion  of  the  literature,  since  it  is  a  broad 
term  that  subsumes  the  other  terms. 

Types  of  CBI.  Kemner-Richardson ’ s  work  defines  the 
following  six  types  of  CBI,  classifying  them  by  their  uses 
and  the  ways  students  interact  with  them.  The  decision  for 
selecting  the  type  best  suited  for  this  research  is 
discussed  in  Chapter  III. 

Informational .  An  informational  CBI  program  treats 
the  computer  as  a  database  containing  information,  text, 
graphics,  and  other  forms  of  data.  Informational  programs 
are  most  often  used  as  supplements  to  more  conventional 
forms  of  instruction  rather  than  as  self-contained 
instruction  (14:19). 

Drill  and  Practice .  Drill  and  practice  CBI  programs 
are  designed  to  help  Individuals  review,  reinforce,  or 
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relearn  a  skill.  As  with  informational  CBI,  drill  and 
practice  is  aost  often  used  to  supplement  conventional 
instruction  methods  (14:27). 

Tutorial .  Tutorial  CBI  programs  use  the  computer  to 
present  the  complete  instruction.  Knowledge  acquisition  and 
comprehension  are  the  goals  of  tutorial  CBI  (14:27). 

Simulation .  Simulation  CBI  packages  are  designed  to 
provide  students  with  practice  in  learning  to  handle  job 
related  situations  (14:22). 

Inquiry.  Inquiry  CBI  combines  the  characteristics 
of  informational  and  tutorial  CBI.  With  this  type  of 
program,  students  have  more  control  over  the  program, 
essentially  selecting  what  they  want  to  learn  (14:24). 

Intelligent .  A  technology  not  yet  fully  developed, 
intelligent  CBI  establishes  a  dialogue  between  the  student 
and  computer,  much  as  a  human  teacher  can  understand  and 
answer  student  questions  in  a  conventional  classroom 
(14:24) . 

Because  this  research  project  focuses  on  the  effects 
which  different  curriculum  structures  may  have  on  students 
in  a  CBI  setting,  it  is  important  to  review  literature 
related  to  effective  use  of  CBI. 

Characteristics  of  CBI .  In  a  technical  report  completed 
in  1986  for  the  US  Navy,  Hamel  and  Clark  established  human 
factors  guidelines  for  the  development  of  computerized 
instruction  (13:1-20).  In  this  comprehensive  review  of 
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existing  CBI  design  literature,  the  authors  identified  five 
principles  as  the  focal  points  for  good  coiputer 
instructional  design: 

1.  Brevity.  This  recoaaendation  suggests  that  the 
inforaation  a  student  aust  aaintain  in  short  tera  aeaory 
or  attend  to  during  the  Instruction  should  be  ainiaized 
(13:3).  The  recoaaendation  is  based  on  the  notion  that 
huaans  have  a  liaited  capacity  to  process  quantities  of 
inforaation.  Design  considerations  here  include 
limiting  the  nuaber  of  text  lines  per  screen  or  "page" 
to  seven,  and  liaiting  as  well  the  aaount  of  highlighted 
aaterial  on  a  page  to  no  aore  than  10  percent  of  the 
screen  display  (13:16). 

2.  Consistency.  Task  demands  should  be  consistent 
within  a  training  systea  in  order  to  develop  user 
expectations  (13:3).  Since  students  aust  develop  a 
correct  aental  model  of  the  systea  they  are  working 
with,  they  should  spend  aost  of  their  tiae  learning  the 
aaterial  in  the  lesson,  not  in  figuring  out  the  CBI 
systea  itself.  Considerations  include  consistent  use 
and  placement  of  labels,  symbols,  and  instructions,  and 
consistent  foraatting  of  functionally  similar  screens 
(13:17) . 

3.  Flexibility.  Flexibility  is  referred  to  using  a 
computer  systea ' s  ability  to  accoaaodate  individual 
differences  among  students  (13:4).  While  the  focus  here 


11 


is  on  computer  program  development  which  includes  review 
and  branching  (moving  to  different  parts  of  the  CBI  at 
will),  considerations  for  self-pacing  through  the  lesson 
may  also  be  an  advantage  (13:18). 

4.  Compatibility.  This  recommendation  means  minimizing 
information  processing  between  stimulus  and  response. 
Additionally,  input  and  output  formats  must  be 
compatible  with  each  other  and  should  be  compatible  with 
established  behavior  patterns  of  the  student  using  the 
system  (13:4).  A  minimum  of  translation,  decoding,  and 
other  forms  of  cognitive  processing  should  be  necessary 
in  order  to  understand  the  information  presented  and  to 
know  how  to  respond  when  required.  Considerations 
include  designs  which  provide  instructions  on  how  users 
should  respond,  and  using  titles,  not  numbers,  to  label 
screens  (pages)  of  the  lesson  on  the  screen  (13:19). 

5.  Responsiveness.  This  guideline  suggests  that 
optimal  timing  of  system  responses  to  student  input  will 
help  students  know  where  they  are  and  what  they  have 
done  (13:5).  Though  the  design  focus  is  on  interactive 
instruction  modes  which  use  questions  embedded  in  the 
CBI  (along  with  correct/incorrect  feedback  to  student 
responses),  other  considerations  include  the  CBI  taking 
no  more  than  five  seconds  to  fill  the  screen  (13:20). 
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An  additional  consideration  in  the  development  of  CBI  is 
the  color  tcheae  of  the  screen  layout.  Research  perforaed 
at  the  Air  Force  Institute  of  Technology  found  that  when 
presented  with  a  number  of  color  options,  users  preferred 
white  text  on  a  blue  background  (21:44). 

Performance  I.gA.tl.DA. 

For  the  purpose  of  this  research,  performance  testing 
entails  having  the  student  complete  a  quiz  over  material 
covered  in  CBI  lessons.  The  following  discussion  pertains 
to  general  performance  measurement  regardless  of  the  type  of 
medium  used  to  deliver  the  instruction. 

It  is  important  in  an  education  setting  to  determine,  in 
some  systematic  way,  whether  learners  have  been  altered  by  a 
set  of  learning  experiences.  Testing  can  be  viewed  as  a 
systematic  sampling  of  an  individual's  characteristics  at  a 
given  time  under  specified  conditions  (10:387),  and  although 
not  an  ideal  performance  measure,  testing  is  the  most  widely 
used  method  to  discover  whether  a  student  has  mastered 
course  content  (7:144-146). 

Of  course,  educators  recognize  the  limitation  of 
testing.  According  to  Bloom, 

The  rather  intangible  quality  of  education 
[learning],  the  difficulty  of  determining  whether  the 
teacher's  efforts  have  had  some  effect,  and  the  search 
for  some  tangible  evidence  of  the  consequences  of 
instruction  have  frequently  led  to  the  use  of 
examinations  as  a  source  of  evidence  and  reassurance 
needed  by  the  teacher.  (10:393) 
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Nonetheless,  Bloom  indicates  that  the  feedback  from 
examinations  may  help  teachers  identify  strengths  and 
weaknesses  in  the  curriculum  and  in  the  learning  experience. 
In  sum,  examinations  should  not  be  considered  an  end  in 
themselves  but  a  process  by  which  the  educational  process 
can  become  more  effective  (10:395). 

The  internal  validity  of  tests  is  crucial  if  an  accurate 
measure  of  student  learning  is  to  be  achieved  (7:150-51; 
10:37-38;  24:11).  Efforts  to  eliminate  errors  in  construct 
validity  are  essential,  but  Instructors  should  first  ensure 
that  performance  measures  are  defined  before  developing 
lesson  plans  and  instructional  materials.  In  this  way,  they 
can  design  tests  which  focus  more  on  performance  objectives 
(content  validity)  than  on  the  effects  an  instructor 
(whether  human  or  CAI )  has  on  the  learning  environment 
(10:37) . 

According  to  Wergln,  one  of  the  important  issues  facing 
test  developers  is  how  to  maximize  two  criteria.  The  first, 
control,  is  the  need  to  ensure  comparability  across  students 
by  requiring  them  to  respond  to  identical  test  stimuli  and 
assessing  their  responses  equally  and  fairly.  The  other 
issue,  relevance,  pertains  to  congruence  between  the  skills 
required  to  perform  well  on  a  test  and  the  knowledge  or 
skills  required  to  accomplish  learning  objectives. 
Unfortunately,  the  two  goals  tend  to  be  mutually  exclusive 
since  tests  which  score  high  in  control  (such  as  multiple 
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choice  teste)  typically  score  low  in  relevance.  As  a 
result,  the  debate  continues  over  the  use  of  objective 
(verifiable  truths)  versus  subjective  (opinion  oriented) 
tests  for  measuring  learning  performance  (24:6-9). 

Objective  Testing .  Should  it  appear  that  subjective 
testing  using  multiple  choice  questioning  is  the  most 
appropriate  performance  measurement  tool,  several  problems 
need  to  be  avoided  in  developing  multiple  choice  questions. 
Although  Emory  discussed  the  following  problems  in  the 
context  of  developing  multiple  choice  opinion  surveys,  these 
issues  appear  to  be  equally  relevant  in  designing  an 
examination  for  the  purpose  of  determining  the  effect  of  CBI 
Instruction.  They  are  described  below  as  problems  to  avoid. 

1.  The  list  of  response  choices  may  not  be  exhaustive. 
That  is  to  say,  respondents  may  want  to  give  an  answer 
that  la  not  one  of  the  choices  presented.  For  example, 

a  respondent  may  be  looking  for  an  answer  which  combines 
two  of  the  choices  offered  and,  as  a  result,  considers 
both  answers  correct  (8:219). 

2.  Alternatives  may  not  be  mutually  exclusive.  A 
respondent  may  see  some  of  the  answers  as  being  equally 
plausible  (8:219). 

3.  Alternatives  offered  for  answering  a  question  may 
not  be  reasonable  (i.e.,  not  possible  answers  to  the 
question )  (8  :  220 ) . 
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4. 


The  order  of  the  possible  answers  aay  create 


unintentional  bias  because  the  placement  of  correct 
answers  falls  into  a  pattern  (8:220). 

5.  Responses  to  questions  aay  not  represent  a  one- 
diaensional  scale.  Therefore,  in  practice,  alternatives 
should  represent  different  aspects  of  the  saae 
conceptual  dlaension  (8:220). 

Suaaar v 

This  chapter  has  reviewed  the  literature  in  three 
iaportant  areas.  First,  the  characteristics  which 
differentiate  inductive  or  bottoa-up  versus  deductive  or 
top-down  structures  were  identified.  Then  the  types  of  CBI 
were  reviewed  as  possible  candidates  for  use  in  the 
research,  along  with  huaan  factors  issues  to  be  considered 
in  the  developaent  of  an  effective  CBI  prograa.  Finally, 
perforaance  testing  literature  was  reviewed  to  provide  not 
only  the  rationale  for  using  perforaance  testing  as  a 
aeasure  of  learning,  but  also  to  establish  guidance  for 
developing  objective  tests.  The  review  of  these  three  areas 
has  laid  the  foundation  for  developing  both  the  CBI  and 
perforaance  test  for  this  research. 
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Ill,  ttg.t.hgdol9*y 


As  stated  In  Chapter  I,  the  research  described  in  this 
report  sought  to  identify  the  correlation,  if  any,  that 
exists  between  CBI  curriculum  structure  and  the  variables  of 
performance  test,  course  completion  time,  and  student 
attitude  about  the  lesson  structure. 

The  major  steps  of  the  methodology  consisted  of  choosing 
the  type  of  CBI  approach  to  use,  selecting  the  research 
population  and  course  content  for  the  study,  developing  the 
top-down  and  bottom-up  versions  of  the  course  and  related 
exam  and  attitude  survey,  administering  the  experimental 
sessions  and  collecting  the  results,  and  interpreting  the 
results.  This  chapter  describes  the  methods  used  to 
accomplish  each  of  these  steps. 

SgJ-cgtinR  th?  CBI  Trpg 

Two  of  the  CBI  types  described  in  Chapter  II  were 
suitable  candidates  for  this  study:  tutorial  and  inquiry. 
Both  of  these  types  are  intended  to  present  complete 
instructional  packages  to  students  who  have  no  prior 
knowledge  of  the  lesson  content,  and  neither  requires 
equipment  or  programming  technology  that  was  not  available 
to  the  Investigator.  Of  the  two,  tutorial  CBI  was  selected. 
Tutorial  is  the  more  fundamental  of  the  two  candidates,  and 
the  research  requirement  to  control  the  students'  progress 
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through  the  lesson  made  the  branching  characteristic  of 
inquiry  CBI  unsuitable. 

A  second  reason  why  a  tutorial  approach  is  appropriate 

is  that  students  needed  to  achieve  what  Krathwohl,  Bloos, 

and  Masia  call  a  "knowledge"  level  of  learning  in  order  that 

their  aastery  could  be  aeasured  by  a  post-course  perforaance 

test.  According  to  Krathwohl,  et.  al,  the  knowledge  level 

involves  the  recall  of  specifics  and  universals,  the 
recall  of  aethods  and  processes,  or  the  recall  of  a 
pattern,  structure,  or  setting.  For  aeasureaent 
purposes,  the  recall  situation  involves  little  aore  than 
bringing  to  aind  the  appropriate  aaterial.  Although 
soae  alteration  of  the  aaterial  aay  be  required,  this  is 
a  relatively  ainor  part  of  the  task.  The  knowledge 
objectives  eaphasize  aost  the  psychological  processes  of 
reaeabering.  (15:185) 

On  the  assuaption  that  reaeabering  is  the  foundation  of 
all  other  levels  of  learning  that  involve  conscious  choices, 
and  because  of  the  tiae  constraints  iaposed  for  coapleting 
the  study,  the  knowledge  level  of  learning  applied  in  the 
tutorial  aode  was  deterained  to  be  the  best  available 
choice  . 

In  addition,  to  avoid  asking  the  tutorial  CBI  prograa 
aerely  an  electronic  page-turning  exercise,  questions  were 
eabedded  in  the  text  throughout  the  top-down  and  bottoa-up 
structured  lessons.  These  self-test  questions  anticipated 
the  questions  students  would  receive  at  the  end  of  the 
lesson,  and  were  developed  in  accordance  with  planned 
knowledge  objectives  and  currlculua  design  theories  (as 
reviewed  in  Chapter  II)  before  prograaaing  began.  Because 
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it  is  the  structure  of  the  lesson,  not  the  content,  which 
differentiates  the  two  program  structures,  development  of 
only  one  set  of  eabedded  questions  was  necessary.  These 
questions  were  then  Inserted  at  the  appropriate  place  in 
each  lesson  structure. 

Selecting  the  Research  Population  and.  Cffi.UJ_je.fi.  Cffi.ntg.H-t 

Selecting  the  research  population  and  course  content  are 
obviously  interrelated  activities,  since  content  should  be 
appropriate  for  the  learners  who  will  study  it.  The 
research  population  for  the  study  consisted  of  Air  Force 
officers  enrolled  at  the  Air  Force  Institute  of  Technology. 
This  population  was  selected  for  both  practical  and 
theoretical  reasons.  On  the  practical  side,  the  population 
was  available  to  the  investigator  at  the  tiae  it  was  needed. 
In  addition,  the  population  consisted  of  individuals  whose 
general  aptitude  was  known  froa  the  admission  criteria  used 
by  the  Institute.  This  fact  suggested  theoretically  that 
strong  differences  in  ability  would  not  be  a  confounding 
variable  in  the  study’s  results.  These  students  were  also 
enrolled  in  related  courses  of  study,  increasing  the 
likelihood  of  choosing  content  for  the  CBI  course  that  would 
have  equal  appeal  to  all  aeabers.  And  finally,  the 
participants'  backgrounds  were  known,  so  that  content  could 
be  selected  that  would  be  new  to  thea,  thus  minimizing  the 
Influence  of  prior  knowledge  on  the  results. 
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The  primary  content  of  the  course  was  aaterial  selected 
from  the  textbook  used  in  AFIT  course  CMGT  523,  Contract  and 
Acquisition  Management  (2:13-1  to  13-20).  This  aaterial 
consisted  of  topics  in  the  areas  of  inspection,  acceptance, 
and  warranties  in  governaent  contract  adainistration . 
Additional  literature  sources  were  used  to  suppleaent  the 
CMGT  523  text  to  enhance  definitions  and  provide  exaaples 
which  deaonstrate  contract  adainistration  principles 
(3:551,583;  23:9-1  to  9-15). 

Bg.y<?l<?.pihg  the  CB1  Lessons  and  Related  Material 

The  following  process  was  used  to  develop  the  CBI 
lessons,  the  perforaance  test,  and  the  attitude  survey. 
Checkpoints  were  injected  throughout  this  process  to  ensure 
that  factors  such  as  the  consistency  between  the  two  lesson 
structures  and  internal  validity  of  aeasureaent  devices 
prevailed . 

CBI  Development .  The  following  steps  were  coapleted 
during  the  developaent  of  the  CBI: 

1.  Once  the  learning  aaterial  for  the  lesson  had 
been  selected,  aain  concepts  were  Identified  as  the  learning 
objectives  for  the  lesson.  These  concepts  were  foraulated 
in  a  tree  diagraa  so  they  could  be  viewed  in  the  Banner  in 
which  they  would  be  presented  to  resesrch  participants. 

2.  Details  surrounding  the  developaent  and 
introduction  of  aain  concepts  were  added  as  the  top-down  and 
bottoa-up  lessons  were  written.  Top-down  or  deductive  and 
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bottom-up  or  Inductive  structuring  techniques,  as  described 
in  the  literature  review  in  Chapter  II,  were  constantly 
reviewed  for  compliance  during  this  step.  Therefore,  the 
focus  at  this  point  was  to  ensure  that  the  curriculum 
structure,  not  the  content  of  the  learning  material  itself, 
was  the  differentiating  factor  between  the  two  lesson  forms. 
In  addition,  clear  transitions  from  concept  to  concept  were 
viewed  as  an  important  outcome.  The  completion  of  this  step 
created  a  product  which  would  be  appropriate  for  use  in  a 
textbook  on  contract  administration. 

3.  With  the  basic  lesson  versions  in  hand,  the 
transfer  process  to  computer  instruction  followed.  The 
computer  code  was  written  in  BASIC  programming  language  for 
its  ease  of  use  and  familiarity  to  the  faculty  member 
advising  the  project.  During  the  transition  to  computer 
program  form,  an  effort  was  made  to  streamline  each  lesson 
into  a  more  bulletized  fashion.  This  was  done  to  eliminate 
extra  wording  which,  though  not  necessarily  detrimental  in  a 
textbook,  could  unnecessarily  lengthen  the  CBI .  This  was 
especially  important  since  the  targeted  length  for  the  CBI, 
in  either  curriculum  structure,  was  sixty  minutes. 

Beginning  with  this  step  and  continuing  through  the 
remainder  of  steps  in  the  CBI  development,  each  lesson  was 
executed  (run)  on  the  computer  and  debugged  as  necessary. 

In  addition,  the  lessons  were  programmed  so  that 
students  could  not  re-accompllsh  any  portion  of  the  CBI 
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prior  to  completing  the  performance  teat.  Thia  was  done  to 
add  aaaurance  that  only  curriculum  atructure  would  be  the 
factor  affecting  the  dependent  variablea  of  the  reaearch 
(performance  teat  score,  courae  completion  time,  and  learner 
attitude  about  the  leaaon).  Finally,  Kemner-Bichardaon ' a 
guidelines  for  effective  CBI,  a a  discussed  in  Chapter  II, 
were  implemented  wherever  possible. 

4.  Once  each  leaaon  was  coded,  a  final  line-by-line 
comparison  of  the  two  program  versions  was  completed  to 
ensure  that  the  content,  and  even  emphasis  on  particular 
ideas  and  concepts,  was  comparable  between  them. 

Differences  outside  the  desired  result  of  curriculum 
structure  were  eliminated  to  prevent  additional  factors  from 
affecting  the  dependent  variables  of  the  research. 

5.  At  this  point  the  introduction  and  end-of-lesson 
screens  were  developed.  In  addition,  questions  to  be 
embedded  in  each  lesson  were  developed  and  inserted  where 
appropriate.  As  mentioned  earlier  only  one  set  of  nine 
embedded  questions  was  required  since  the  course  material 
within  each  lesson  was  the  same — only  curriculum  structure 
was  different  between  lessons. 

6.  With  both  top-down  and  bottom-up  CBI  lessons 
complete,  the  next  step  involved  error-checking  to  make  sure 
both  correct  and  Incorrect  keystrokes  were  adequately 
managed  within  the  coded  programs.  Once  each  lesson  was 
thoroughly  checked  out,  a  master  copy  of  each  was  made.  Six 
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duplicate  coplea  of  each  lesson,  five  primary  and  one 
backup,  were  aade  for  the  conduct  of  the  experlaent.  AFIT 
coaputer  reaourcea  in  building  641  on  Wright-Patteraon  AFB 
were  used  to  execute  the  experlaent. 

Appendices  A  and  B  contain  the  BASIC  prograa  for  the 
top-down  lesson  and  bottoa-up  lesson  respectively. 

Experiaental  Design .  A  post-test-only  control  group 
design  was  chosen  for  the  research.  Blocking  techniques, 
useful  in  ellainating  the  effects  of  confounding  factors, 
were  not  Included  in  the  design.  This  is  because  the 
investigator  felt  any  factors  which  aight  affect  the 
research  had  been  accounted  for  and  reasonably  controlled. 
Pretests  were  also  assuaed  unnecessary  considering,  1)  the 
Investigator ' s  extensive  use  of  randoaized  processes 
throughout  the  design  of  the  experlaent,  and  2)  the  AFIT 
selection  criteria  described  earlier  (which  produces  a 
hoaogenous  population  of  students  froa  which  to  draw).  As  a 
result,  a  single  perforaance  test  was  developed  using 
knowledge  level  objectives  defined  earlier  in  this  chapter. 

Perforaance  Test  Dcvclopaent.  Eaory'a  recoaaendations  for 
creating  objective  (aultiple-choice )  questions,  outlined  in 
Chapter  II,  were  the  cornerstone  of  perforaance  test  developaent. 
To  ensure  identical  leaaon  content  while  producing  the  CBI,  a 
line-by-line  analysis  was  done  to  ensure  that  answers  to  each 
question  were  identically  defined  and  highlighted  within 
each  structure.  The  result  of  the  perforaance  test 
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development  effort  was  a  twenty  question  multiple-choice 
test,  attached  in  Appendix  C. 

Finally,  a  technique  for  randomly  ordering  the  questions 
was  chosen.  Using  the  top-down  lesson  (the  bottom-up 
structure  could  have  been  used  just  as  well),  questions  were 
ordered  based  on  where  they  were  discussed  from  the 
beginning  to  the  lesson's  end.  Using  the  middle  of  the 
lesson  as  a  starting  point,  the  question  which  lay  closest 
to  that  middle  was  selected  as  the  first  item  for  the 
performance  test.  Then,  selecting  questions  alternately 
from  one  side  and  then  the  other  side  of  the  middle  of  the 
material,  the  remainder  of  the  questions  were  ordered.  The 
result  was  a  structure  of  question-asking  which  favored 
neither  the  top-down  or  bottom-up  lesson  structures,  thus 
eliminating  one  more  factor  which  could  have  affected  the 
outcome  of  the  research. 

Attitude  toil  PcvglPPlgnt-  To  collect  user  attitudes 
about  the  lessons,  a  summated  scale  survey,  in  particular 
the  Likert  Scale,  was  chosen  for  its  appropriateness  to  the 
research  design  and  ease  of  application.  To  develop  the 
survey,  the  investigator  followed  Emory's  recommendations 
for  judging  each  statement  in  the  survey.  Each  survey 
statement  must,  1)  be  relevant  to  the  attitude  being 
studied,  and  2)  reflect  both  a  favorable  and  unfavorable 
position  on  that  attitude  (8:256).  A  five  point  scale  was 
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chosen  for  the  survey,  with  sttitude  choices  ringing  as 
shown  below: 


+ - 

5 

4 

3 

2 

1 

Strongly 

Somewhat 

Neutral 

Somewhat 

Strongly 

Agree 

Agree 

Disagree 

Disagree 

The  statements  for  the  survey  were  developed  within  the 
four  subject  area  categories  identified  below. 

1.  Structure.  This  category  sought  feedback  on  the 
curriculum  structure  of  the  program  and  the  ease  with 
which  the  participant  was  able  to  learn  using  that 
structure.  An  additional  consideration  for  this  subject 
area  was  the  participant's  ability  to  complete  the  quiz. 

2.  Content.  This  category  considered  the  content 
of  each  structured  lesson  as  well  as  the  adequacy  in  the 
levels  of  detail  (and  definitions)  used  to  help 
participant’s  learn  the  material. 

3.  User  Friendliness.  This  category  sought  to 
determine  each  participant's  perception  on  the  clarity 
of  the  instruction,  identify  a  preference  or  lack 
thereof  for  CBI,  and  provide  feedback  on  whether  the 
participant  would  like  to  take  another  course  offered  in 
an  identical  manner. 
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4.  Screen  Appearance.  This  final  category  tree 
designed  to  deteraine  whether  or  not  the  participant 
liked  the  appearance  (ease  of  reading  screens,  etc.)  of 
the  screens.  This  area  was  developed  to  deteraine  if 
the  appearance  of  the  CBI  hindered  student  perforaance. 
The  coapleted  version  of  the  attitude  survey,  located  in 
Appendix  0,  contained  sixteen  scoring  stateaents  and  two 
coaaent  areas  (where  participants  could  provide  additional 
feedback  about  the  lesson). 

Sample  Experiment  Session .  Once  the  course,  perforaance 
test,  and  attitude  survey  were  coaplete,  the  next  logical 
step  appeared  to  be  inviting  participation  in  the  research. 
However,  before  adainlsterlng  group  experlaental  sessions  in 
the  aanner  described  in  the  following  paragraphs,  a  sample 
session  was  conducted  using  one  volunteer  student.  This  was 
done  to  obtain  an  estiaate  of  how  long  it  would  take  other 
students  to  coaplete  the  CBI,  perforaance  test,  and  attitude 
survey.  The  estiaated  tiaea  were  then  used  to  schedule 
coaputer  resources  and  provide  volunteers  with  reasonably 
accurate  estlaates  of  how  long  they  could  expect  the 
experiaent  to  last. 

The  bottoa-up  lesson  was  selected  for  the  student  since 
it  was  physically  13. 2X  (in  teras  of  disk  storage  space) 
longer  than  the  top-down  lesson  and  would  possibly  provide 
an  upper-ended  tiae  eatiaate  for  the  exercise.  The  saaple 
student  coapleted  the  CBI  portion  in  26  ainutes,  the 
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performance  test  in  6  minutes,  and  the  survey  In  8  minutes 
for  a  total  time  of  39  minutes.  This  estimate  proved  to  be 
very  accurate  during  the  actual  conduct  of  the  experiment. 
As  a  result,  computer  resources  were  better  scheduled  and 
students  were  left  with  positive  impressions  when  they 
actually  completed  the  session  in  less  than  the  hour  they 
were  told  to  expect. 

Administering  the  Experimental  Sessions 

The  following  steps  were  accomplished  during  the 
preparation  and  conduct  of  the  research  experiments. 

Step  1 .  Scheduling  Participants.  Scheduling 
participants  involved  reserving  the  computer  laboratory 
(room  315)  in  AFIT/LS  and  canvassing  for  volunteers. 

Step  £.•  Random  Assignment.  Random  assignment  involved 
using  a  pseudorandom  number  generator  function  in  MATHCAD 
Version  2.0  (1:96-97)  to  randomly  assign  a  lesson  structure 
to  each  computer  terminal,  a  lesson  structure  to  each 
volunteer,  and  a  location  within  the  computer  laboratory 
where  each  volunteer  would  sit.  Given  that  ten  Zenith 
computer  terminals  were  available  at  one  time  in  the 
laboratory,  five  terminals  were  assigned  to  each  of  the  two 
lesson  structures. 

Step  2_.  Experiment  Set-up.  Experiment  set-up  involved 
preparing  the  computer  laboratory  and  ensuring  both 
materials  used  and  measurements  taken  for  each  of  the 
participants  were  accurately  tracked  during  the  experiment. 
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To  meet  this  latter  purpose,  the  researcher  kept  a  journal 
which  detailed  where  volunteers  and  specific  experiment 
materials  (computer  disks,  etc.)  were  located.  In  addition, 
cover  sheets  for  booklets  containing  the  performance  test 
and  survey  were  coded  to  indicate  whether  the  results  within 
the  booklet  were  the  result  of  top-down  or  bottom-up  lesson 
execution.  This  code  was  transparent  to  the  participants; 
the  date  form  "July  19,  1990H  was  used  for  top-down 
participants  while  the  form  "19  Jul  90”  was  used  for  bottom- 
up  participants.  Once  program  disks  were  loaded  into  their 
designated  computers,  the  booklets  were  put  inside  envelopes 
and  placed  beside  the  terminal.  Each  CBI  lesson  disk  was 
then  run  through  a  final  check  to  be  sure  it  performed 
without  error.  Monitors  were  then  cleared  to  reveal  a  blue 
screen,  giving  an  identical  appearance  to  all  computer 
stations . 

Step  £..  Conduct.  Conduct  involved  welcoming 
participants  into  the  experimental  setting,  ensuring  they 
were  properly  seated,  and  briefing  them  on  conduct  of  the 
experiment.  Once  participants  were  given  a  signal  to  begin, 
an  elapsed  time  was  started  and  tracked  in  one-minute 
increments.  These  incrementa  were  written  on  a  marker  board 
at  the  front  of  the  laboratory  until  the  last  participant 
completed  the  computer  portion  of  the  exercise.  As  soon  as 
they  finished  their  CBI  lesson,  participants  were  instructed 
to  write  this  elapsed  time  on  the  cover  of  the  booklet 
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located  in  the  envelope  beside  their  terminal .  This  data 
was  then  used  to  assess  the  impact,  if  any,  that  lesson 
structure  had  on  course  completion  time. 

Step  5_.  Data  Collection.  Data  collection  involved 
collecting  data  provided  by  the  participants  and  returning 
the  computer  laboratory  to  its  pre-experiment  configuration. 

Pfl-ta  Analysis 

The  initial  stage  in  the  data  analysis  Involved 
determining  the  type  of  data  available  from  the  experiment. 
That  is,  which  of  the  four  common  classifications  was 
appropriate:  nominal,  ordinal,  interval,  or  ratio  (8:87). 

The  scores  from  the  performance  testing  and  course 
completion  timing  were  treated  as  interval -level  data. 
However,  classification  of  the  Likert  scale  scores  was  not 
quite  as  straightforward. 

Some  authorities  hold  that  Likert  scales  produce  ordinal 
data  only  (8:258),  while  others  hold  that  if  a  survey  is 
well  enough  prepared,  distinctions  about  how  much  more  or 
less  favorable  a  respondent  feels  about  a  topic  can  be 
determined  from  this  scale  (9).  This  research  was  built  on 
the  later  argument,  and  as  a  result  the  data  obtained  from 
the  Likert  scale  survey  was  treated  (assumed)  as  interval- 
level  data.  This  enabled  the  investigator  to  have  the 
option,  before  analyzing  the  data,  of  using  either 
parametric  or  non-parametric  statistical  test  procedures. 
However,  parametric  procedures  require  the  data  to  be 
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normally  distributed,  while  non-parametric  procedures  are 
less  restrictive  and  are  often  simultaneously  valid  for  many 
different  types  of  data  distributions  (5:592).  Therefore, 
selecting  the  aost  appropriate  procedure  would  depend,  as 
the  following  paragraphs  indicate,  on  the  distributions  of 
the  research  data. 

The  top-down  and  bottoa-up  data  were  organized  into 
eighteen  analysis  areas:  the  performance  test  scores,  the 
course  coapletion  tines,  and  the  sixteen  scoreable 
statements  of  the  attitude  survey.  A  Wilk-Shapiro  test  for 
normality  using  STATISTIX  (17:6.4),  a  statictical  analysis 
programming  tool,  was  performed  for  the  top-down  and  bottoa- 
up  data  in  each  set.  Applying  the  criterion  thit  the 
statistic  produced  by  t  ;e  Wilk-Shapiro  test  be  must  at  least 
0.9  in  order  to  classify  data  as  normally  distributed,  only 
two  of  the  (36)  distributions  qualified.  Further,  none  of 
these  analysis  areas  had  both  data  sets  pass  the  normality 
test.  This  left,  for  instance,  normally  distributed  top- 
down  performance  test  data  to  be  compared  with  bottom-up 
performance  test  data  which  was  not  normally  distributed. 
Devore  offers  a  solution  to  such  situations,  indicating  that 
distribution-free  procedures  perform  almost  as  well  as  t  and 
F-tests  used  for  normally  distributed  data,  and  can  offer 
considerable  improvement  under  non-normal  conditions 
(5:592).  For  this  reason  the  Investigator  chos-  to  pursu 
non-par ametric  analysis  for  the  research  data.  With  this 
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decision,  the  investigator  turned  to  deciding  which  non- 
paraietric  test  was  most  appropriate. 

As  stated  earlier,  two  sub-populations  (out  of  the 
general  AFIT  population)  were  created  by  the  post-test 
randonized  design  used  to  aeasure  the  effect  of  curriculum 
structure  (a  single  factor).  According  to  the  literature, 
there  are  a  number  of  non-parametric  tests  which  can  be  used 
to  analyze  such  designs  (5:592).  The  key  assumption  in  many 
of  these  tests  is  that  observed  scores  (data  values)  are 
drawn  from  an  underlying  continuous,  versus  discrete, 
distribution;  this  assumption  of  an  underlying  continuum  is 
especially  important  for  those  tests  which  require  at  least 
ordinal-level  data  (20:25).  Proper  classification  of  the 
data  requires  understanding  the  distinctions  between 
continuous  and  discrete  random  variables.  According  to 
Siegel , 

A  discrete  variate  [random  variable]  is  one  which 
can  take  on  only  a  finite  number  of  values;  a  continuous 
variate  is  one  which  can  (but  may  not)  take  on  a 
continuous  infinity  of  values.  (20:25) 

By  this  definition,  the  performance  test  and  course 

completion  time  data  fit  in  the  category  of  continuous 

distributions.  The  attitude  survey  results  are  also 

continuous  because,  once  again  referencing  Siegel,  even 

though  the  measurement  points  of  the  survey  were  predefined 

points  on  a  (Likert)  scale,  it  is  reasonable  to  assume  that 

an  underlying  continuum  exists  for  that  data  (20:25). 
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These  descriptions  of  the  experinental  design,  along 
with  the  assuaption  of  an  underlying  continuum  fit  the 
criteria  for  application  of  the  Kruskal-Wallis  Test,  a 
distribution-free  analysis  of  variance  (5:622).  Therefore 
the  Kruskal-Wallis  Test  was  used  to  analyze  each  of  the 
eighteen  analysis  areas  described  earlier. 

In  this  analysis,  the  investigator  did  not  initially 
assume  a  significance  level  (alpha)  which  might  correlate 
with  a  level  the  reader  would  conaider  appropriate. 

Instead,  the  key  outcome  in  any  of  the  Kruskal-Wallis  tests 
was  the  p-value.  This  value  was  then  used  to  determine  the 
smallest  level  of  significance  at  which  a  null  hypothesis 
could  be  rejected,  thereby  allowing  the  reader  to  determine 
the  significance  of  the  data.  Later,  the  investigator  used 
a  p-value  of  0.1  as  a  significance  Indicator  for  conclusions 
drawn  in  Chapter  VI  (Conclusions/Becommendations ) . 

The  results  of  using  the  analysis  methods  described  above 
are  reported  in  the  next  chapter. 
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IV.  RggUltg 


Introduction 

This  chapter  presents  the  raw  data  and  corresponding 
descriptive  statistics  collected  from  the  research 
experiments  as  described  in  Chapter  III.  As  that  chapter 
indicates,  the  primary  data  consisted  of  each  participant's 
performance  test  scores,  (CBI)  course  completion  time,  and 
attitude  survey  scores. 

Three  experimental  sessions  were  conducted  in  order  to 
accommodate  the  24  students  who  volunteered  to  participate. 
Twelve  students  apiece  were  randomly  assigned  into  both  the 
top-down  and  bottom-up  structured  lessons.  However,  a 
malfunction  of  the  video  display  during  one  of  the  bottom-up 
CBI  lessons,  which  the  participant  did  make  the  Investigator 
aware  of  until  after  the  experiment,  was  significant  enough 
to  adversely  affect  that  participant's  view  of  the  lesson, 
thereby  warranting  elimination  of  that  data  from  the 
results.  This  left  the  two  randomly  assigned  populations 
uneven.  To  balance  the  populations  for  statistical 
analysis,  the  investigator  randomly  selected  one  top-down 
participants’  data  and  excluded  it  from  these  results, 
leaving  11  participants  in  each  lesson  structure. 

Fcrfonancs  ie»t  and  course  CgiPlction  lias.  Raaalit 

Table  1  provides  performance  test  scores  and  timing  data 
for  each  of  the  22  participants.  Completion  times  are  in 


33 


ainutes,  while  test  scores  reflect  a  percentage,  on  a  scale 
of  0-to-100,  of  correct  responses  to  the  20-questlon  quiz. 


TABLE  1 


CBI  PERFORMANCE 
COMPLETION 

TEST  AND  COURSE 
TIME  RESULTS 

PERFORMANCE 

COMPLETION 

CURRICULUM 

TEST  SCORE 

TIME 

STUDENT 

STRUCTURE 

(percent) 

iNlnut.g*). 

1 

B 

80 

25 

2 

B 

60 

19 

3 

B 

90 

18 

4 

B 

90 

17 

5 

B 

75 

23 

6 

B 

90 

19 

7 

B 

90 

23 

8 

B 

90 

21 

9 

B 

85 

17 

10 

B 

70 

25 

11 

B 

80 

21 

12 

T 

95 

20 

13 

T 

90 

27 

14 

T 

80 

22 

15 

T 

80 

17 

16 

T 

90 

13 

17 

T 

65 

22 

18 

T 

90 

19 

19 

T 

80 

19 

20 

T 

80 

19 

21 

T 

75 

18 

22 

T 

65 

19 

B  -  Designator  for  the  bottoa-up  currlculua  structure 
T  =  Designator  for  the  top-down  curriculua  structure 


To  validate  the  tiae  data,  the  investigator  randoaly 
chose  two  participants  in  each  experiaent  session  and 
aonitored  their  CBI  coapletion  tiae  for  later  coaparison 
with  the  tiae  they  docuaented  on  their  test  booklets.  In 
each  case  the  participants  recorded  their  tiaes  accurately. 
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Likert  Scale  Survey  Rggylti 


As  Chapter  III  indicated,  there  were  16  survey  items  for 
each  participant  to  score  using  the  Likert  Scale.  Table  2 
indicates  the  scores  applied  by  each  of  the  22  participants. 

TABLE  2 

ATTITUDE  SURVEY  RESULTS 


SURVEY 

STATEMENT 

STUDENT 

A. 

L 

c. 

c. 

L 

L 

(L 

H. 

L 

L 

L 

ML 

H 

Q. 

L 

Q. 

1-B 

3 

4 

4 

4 

3 

4 

4 

4 

4 

3 

4 

4 

4 

2 

4 

4 

2-B 

3 

2 

3 

3 

2 

4 

4 

4 

4 

3 

4 

3 

3 

4 

3 

2 

3-B 

3 

5 

4 

4 

4 

4 

5 

4 

5 

4 

4 

4 

4 

2 

5 

5 

4-B 

2 

3 

4 

4 

4 

4 

5 

5 

5 

4 

4 

4 

4 

2 

5 

4 

5-B 

3 

4 

4 

2 

4 

5 

5 

5 

5 

5 

M 

M 

M 

M 

M 

M 

6-B 

2 

4 

5 

4 

5 

2 

5 

5 

5 

4 

5 

5 

5 

2 

5 

5 

7-B 

3 

5 

5 

4 

5 

3 

5 

5 

5 

5 

5 

4 

5 

2 

5 

5 

8-B 

M 

4 

5 

4 

4 

5 

4 

5 

5 

4 

4 

5 

4 

2 

4 

4 

9-B 

3 

2 

3 

4 

4 

5 

3 

5 

5 

3 

5 

5 

5 

2 

3 

3 

10-B 

3 

4 

4 

2 

5 

3 

5 

5 

5 

5 

4 

3 

4 

3 

5 

5 

11-B 

2 

3 

4 

3 

4 

2 

4 

5 

5 

3 

5 

4 

4 

3 

4 

4 

12-T 

3 

4 

4 

3 

4 

4 

4 

5 

5 

4 

M 

4 

4 

2 

4 

5 

13-T 

3 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

3 

4 

2 

4 

4 

14-T 

3 

4 

4 

4 

4 

4 

5 

3 

5 

4 

4 

4 

4 

3 

5 

5 

15  -T 

2 

5 

4 

5 

4 

3 

4 

5 

5 

4 

4 

5 

5 

3 

4 

4 

16-T 

2 

3 

4 

4 

4 

5 

4 

4 

5 

4 

4 

4 

4 

3 

4 

4 

1 7-T 

3 

4 

4 

3 

4 

2 

4 

4 

4 

4 

4 

3 

4 

3 

4 

4 

18  -T 

1 

5 

4 

4 

4 

3 

5 

5 

5 

4 

4 

4 

5 

2 

4 

4 

19-T 

3 

4 

4 

4 

4 

4 

4 

4 

4 

4 

M 

M 

M 

M 

M 

M 

20-T 

1 

4 

4 

4 

4 

1 

5 

5 

5 

4 

5 

4 

3 

4 

4 

4 

21-T 

3 

4 

4 

4 

3 

1 

4 

4 

5 

2 

4 

3 

5 

3 

4 

4 

22  -T 

3 

4 

4 

4 

4 

3 

4 

5 

5 

4 

4 

4 

4 

3 

4 

4 

B  =  Designator  for  the  bottoa-up  curriculum  structure 
T  *  Designator  for  the  top-down  curriculum  structure 
M  =  Missing 


The  16  statements  are  labeled  as  they  appeared  in  the 
actual  survey.  Results  from  the  scoring  ranged  from  a  high 
of  5  (strongly  agree)  to  a  low  of  1  (strongly  disagree). 
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Statement*  k  and  r  do  not  appear  in  Table  2  aince  they  were 
comment  response  items  for  the  survey.  Responses  annotated 
"M"  (for  "missing")  indicate  where  a  participant,  for 
unknown  reasons,  did  not  respond. 

Survey  Comments .  The  attitude  survey  gave  each  of  the  22 
participants  2  opportunities  (items  k  and  r)  to  write  in 
comments  about  the  CBI,  performance  test,  and  survey. 

Though  44  written  responses  were  possible,  only  5  responses 
were  provided.  While  the  comments  are  reproduced  verbatim 
in  Appendix  E,  the  gist  of  each  one  is  indicated  below: 

1.  Too  much  information  was  presented  in  lesson 
paragraphs,  making  reading  difficult. 

2.  Anticipation  of  concepts  was  not  possible  due  to 
a  lack  of  familiarity  of  the  subject  matter. 

3.  The  CBI  offered  no  advantage  over  reading  a 
paper  text,  especially  since  computer  graphics  and  an 
ability  to  back-track  in  the  program  were  not  provided. 

4.  Paper  copy  allows  back-tracking  if  necessary. 

The  program's  use  of  paragraph  structure  and  lists  made  the 
lesson  seem  less  intimidating  (than  a  screenful  of  text). 

5.  Highlighting  main  concepts,  and  a  facility  for 
back-tracking,  would  have  improved  the  lesson. 

Descriptive  Statistics 

The  interactive  statistical  programming  tool  STATISTIX 
was  used  to  calculate  descriptive  statistics  on  the  data 
presented  in  the  following  paragraphs. 
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Performance  Test  and  Course  CftWPlfttjgn  1 1.1  ft  •  Table  3 
shows  the  statistics  which  describe  the  perforaance  test  and 
course  coapletion  tiae  results.  Eleven  aeasureaents  for 
each  lesson  structure  are  provided  for  each  variable.  Mean 
scores  for  top-down  and  bottoa-up  test  perforaance  test 
scores  were  80.91  and  81.82  respectively.  Course  coapletion 
tine  averages  were  19.55  for  the  top-down  lessons  and  20.73 
for  botton-up  lessons. 

TABLE  3 


STATISTICS  FOR  PERFORMANCE  TEST  AND  COURSE  COMPLETION  TIME 


CURRICULUM 

SAMPLE 

STD 

VARIABLE 

STRUCTURE 

SIZE 

KEAN 

DEV 

MEDIAN 

PERFORMANCE 

B 

11 

81.82 

10.07 

85 

TEST  SCORE 

T 

11 

80.91 

9.95 

80 

TIME  (MIN) 

B 

11 

20.73 

2.97 

21 

T 

11 

19.55 

3.48 

19 

B  =  Designator  for  the  bottoa-up  curriculua  structure 
T  =  Designator  for  the  top-down  curriculua  structure 


Attitude  Survey .  Before  these  statistics  were 
calculated,  the  investigator  atteapted  to  negate  the  saaple 
size  iabalance  caused  by  the  non-response  areas  (labeled 
"M")  seen  in  Table  2.  This  was  done  by  randoaly  selecting  a 
response  in  the  larger  set  and  reaoving  that  response  froa 
the  results.  Specifically,  one  top-down  response  on  ltea 
"a"  (the  value  2),  and  one  bottoa-up  response  on  itea  "1H 
(the  value  5)  were  deleted.  Non-response  areas  ”1  through 
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qM  by  participants  5  and  19,  occurring  in  bottom-up  and  top- 
down  results  respectively,  were  treated  as  though  they 
balanced  each  other;  therefore  no  random  deletions  were 
necessary  in  those  Instances.  The  results  of  this  data 
handling  are  reported  in  Table  4. 

TABLE  4 

STATISTICS  FOR  ATTITUDE  SURVEY  RESPONSES 


SAMPLE 

SURVEY  SIZE 


STANDARD 

MEAN  DEVIATION 


QUESTION  B.  L  L  B.  L  L  Bl  LI. 


A 

10 

/ 

10 

2.70 

/ 

2.50 

0.48 

/ 

0.85 

B 

11 

/ 

11 

3.64 

/ 

4.09 

1.03 

/ 

0.54 

C 

11 

/ 

11 

4.09 

/ 

4.00 

0.70 

/ 

0.00 

D 

11 

/ 

11 

3.46 

/ 

3.91 

0.82 

/ 

0.54 

E 

11 

/ 

11 

4.00 

/ 

3.91 

0.89 

/ 

0.30 

F 

11 

/ 

11 

3.73 

/ 

3.09 

1.10 

/ 

1.30 

G 

11 

/ 

11 

4 . 46 

/ 

4.27 

0.69 

/ 

0.47 

H 

11 

/ 

11 

4.73 

/ 

4.36 

0.47 

/ 

0.67 

I 

11 

/ 

11 

4.82 

/ 

4.73 

0.40 

/ 

0.47 

J 

11 

/ 

11 

3.91 

/ 

3.82 

0.83 

/ 

0.60 

L 

9 

/ 

9 

4.33 

/ 

4.11 

0.50 

/ 

0.33 

M 

10 

/ 

10 

4.10 

/ 

3.80 

0.74 

/ 

0.63 

N 

10 

/ 

10 

4.20 

/ 

4.20 

0.63 

/ 

0.63 

0 

10 

/ 

10 

2.40 

/ 

2.80 

0.70 

/ 

0.63 

P 

10 

/ 

10 

4.30 

/ 

4.10 

0.82 

/ 

0.32 

Q 

10 

/ 

10 

4.10 

/ 

4.20 

0.99 

/ 

0.42 

MEDIAN 

B .LI. 

3/3 

4/4 

4/4 

4/4 

4/4 

4/3 

5/4 

5/4 

5/5 

4/4 

4/4 

4/4 

4/4 

2/3 

4/4 

4/4 


B  =  Designator  for  the  bottom-up  curriculum  structure 
T  »  Designator  for  the  top-down  curriculum  structure 


The  following  chapter  presents  the  analysis  of  the 
experimental  results  described  in  this  chapter. 
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5 U.  An«ly»it 


Ibis  chapter  analyzes  the  data  presented  in  Chapter  IV. 
The  analysis  consisted  of  establishing  the  normality  of  the 
data  distributions,  performing  hypothesis  tests,  and 
identifying  the  effect  the  research  variables  might  have  on 
one  another. 

Data  Distribution  Anil/filS 

A  Wilk-Shapiro  normality  statistic  was  calculated  for 
the  top-down  and  bottom-up  data  pairs  analyzed  for  each  of 
the  research  variables. 

Performance  lest  and  Q&JAX&S.  Completion  Time.  Table  5 
shows  the  results  of  the  normality  test  performed  for  these 
data  sets.  This  analysis  Indicates  that  only  one  data  set 
in  each  qualifies  as  normally  distributed  (using  the  0.9 
statistic  criteria  from  Chapter  IV),  thereby  eliminating 
parametric  test  procedures  from  use  later  in  this  analysis. 

TABLE  5 


WILK-SHAPIRO  NORMALITY  OF  PERFORMANCE  TEST  AND  TIME  DATA 


DEPENDENT 

CURRICULUM 

NORMALITY 

UR1A&LL 

STRUCTURE 

STATISTIC 

PERFORMANCE  TEST 

B 

0.8339 

T 

0.9143 

COURSE  COMPLETION 

B 

0.9398 

TIME 

T 

0.8907 

B  *  Designator  for  the  bottom-up  curriculum  structure 
T  *  Designator  for  the  top-down  curriculum  structure 
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Attitude  Survey.  Table  6  shows  the  results  of  the 


noraality  test  perforaed  for  the  attitude  data.  This 
analysis  was  done  for  each  of  the  sixteen  scored  iteas  of 
the  survey.  The  statistic  values  range  froa  a  low  of  0.3119 
to  a  high  of  0.9080.  The  value  NKH  for  the  top-down  analysis 
in  the  third  survey  stateaent  indicates  that  a  condition  of 
non-noraality  prevented  calculation  of  the  statistic.  As 
the  table  indicates,  only  one  top-down  data  set  aet  the 
criteria  for  a  noraal  distribution,  leading  the  investigator 
to  conclude  that  hypothesis  tests  with  this  data  were  best 
conducted  with  non-paraaetric  (distribution-free)  test 
procedures . 


TABLE  6 

WILK-SHAPIRO  NORMALITY  OF  ATTITUDE  SURVEY  DATA 


WILK-SKAPIRO 

SURVEY  STATISTIC 


SIAIEMEKI 

BOTTOM-UP 

TOP-DOWN 

A 

0.6146 

0.6396 

B 

0.8913 

0.6944 

C 

0.8329 

M 

D 

0.7045 

0.6944 

E 

0.8158 

0.3119 

F 

0.8996 

0.9080 

G 

0.7606 

0.5887 

H 

0.5887 

0.7911 

I 

0.4827 

0.5887 

J 

0.8487 

0.3119 

L 

0.6424 

0.3570 

M 

0.8484 

0.7869 

N 

0.7869 

0.7869 

0 

0.6439 

0.7869 

P 

0.8051 

0.3326 

Q 

0.8310 

0.5095 
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Tables  5  and  6  demonstrate  that  none  of  the  data  pairs 
had  both  values  meet  the  normality  criteria.  This  result, 
along  with  the  randomized  design  and  the  assumption  that  the 
data  is  continuous,  led  to  the  application  of  Kruskal-Wallis 
( non-parametric )  statistical  test  procedures.  That  analysis 
ia  presented  in  the  following  paragraphs. 

Kruskal-Wallis  Hypothesis  Toting 

The  null  hypothesis  evaluated  for  each  of  the  (eighteen) 
data  pairs  identified  in  Tables  5  and  6  was  stated  as 
follows:  the  mean  from  the  top-down  distribution  equals  the 

mean  from  the  bottom-up  distribution.  Said  another  way,  the 
means  came  from  the  same  distribution,  indicating  that 
curriculum  structure  did  not  cause  a  significant  difference 
in  the  outcomes  measured  during  the  research.  The  alternate 
hypothesis  stated  that  the  means  were  not  equal,  leading  one 
to  conclude  that  the  data  created  as  a  result  of  curriculum 
structure  was  significant. 

The  Kruskal-Wallis  analysis  was  reported  as  p-value 
calculations  in  each  of  the  tests  performed.  As  Chapter  III 
pointed  out,  the  p-value  establishes  the  smallest  level  at 
which  a  null  hypothesis  can  be  rejected.  By  reporting  the 
results  of  the  analysis  in  this  manner,  the  reader  was  given 
the  opportunity  to  set  the  data  significance  criteria  as  he 
or  she  saw  fit.  As  for  the  investigator's  criterion,  a 
significance  factor  of  0.1  was  applied  in  the  analysis. 
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Performance  Teat  and  Courae  gaaBlfctlflfl  II  1C  •  Table  7 
shows  the  Kruskal-Wallis  analysis  for  performance  test  and 
courae  completion  time  data,  the  p-valuea  of  which  were 
0.8118  and  0.4645  respectively.  Using  a  0.1  significance 
level  led  the  investigator  to  conclude  that  the  null 
hypothesis,  for  both  research  variables,  should  not  be 
rejected.  The  average  scores  fron  the  perforaance  test  do 
not  allow  one  to  conclude,  given  0.1  significance,  that 
curriculum  structure  caused  them  to  be  significantly 
different  froa  one  another.  Similar  results  were  found  in 
the  analysis  for  course  completion  time. 

TABLE  7 

KRUSKAL-WALLIS  ANALYSIS  FOR 


PERFORMANCE  TEST  AND  COURSE  COMPLETION  TIME  DATA 


RESEARCH 

MEAN 

VALUES 

VARIABLE 

BOTTOM-UP 

TOP-DOWN 

P-VALUE 

SSQNiriCMI 

PERFORMANCE 
TEST  SCORE 

80.91 

81.82 

0.8118 

NO 

COMPLETION 
TIME  (min) 

19.55 

20.73 

0.4645 

NO 

Attitude  Surve y .  Table  8  shows  the  Kruskal-Wallis 
analysis  for  the  Likert  scale  attitude  survey.  P-values  for 
these  tests  ranged  fron  a  low  of  0.1311  to  a  high  of  0.9695. 
Further,  a  value  marked  "tied"  appears  in  the  table  to 
indicate  a  test  where  too  many  ties  occurred  during  the 
Kruskal-Wallis  computations,  thereby  preventing  the  report 
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of  a  p-value  in  that  inatance .  Aa  with  the  previoua  teat 
results,  the  attitude  analysis  indicates  that  the  data  was 
not  statistically  significant  (at  0.1)  for  any  of  the  survey 
statements . 


TABLE  8 


KRUSKAL 

-WALLIS  ANALYSIS  FOR 

THE  ATTITUDE 

SURVEY 

SURVEY 

MEAN 

VALUES 

ITEM 

BOTTOM-UP 

TOP-DOWN 

P-VAEVE 

SIGNIFICANT 

A 

2.70 

2.50 

0.7784 

NO 

B 

3.64 

4.09 

0.2828 

NO 

C 

4.09 

4.00 

0.6218 

NO 

D 

3.46 

3.91 

0.1881 

NO 

E 

4.00 

3.91 

0.4504 

NO 

F 

3.73 

3.09 

0.2478 

NO 

G 

4.46 

4.27 

0.3498 

NO 

H 

4.73 

4.36 

0.1715 

HO 

I 

4.82 

4.73 

0.6192 

NO 

J 

3.91 

3.82 

0.9695 

NO 

L 

4.33 

4.11 

0.2705 

NO 

M 

4.10 

3.80 

0.3347 

NO 

N 

4.20 

4.20 

TIED 

NO 

0 

2.40 

2.80 

0.1311 

NO 

P 

4.30 

4.10 

0.3395 

NO 

0 

4.10 

4.20 

0.8662 

NO 

Addition*!  Attitude  Survey  Analysis 

While  the  results  in  Table  8  demonstrate  that  the  survey 
data  was  not  statistically  significant,  there  are  Insights 
which  can  be  gleaned  from  the  way  top-down  and  bottom-up 


participants  either  agreed,  stayed  neutral,  or  disagreed 
with  the  survey  statements.  Table  9  lists  each  survey 
statement  and  the  number  of  participants  within  each  lesson 
structure  who  responded  in  these  three  manners.  Using  the 


Likert  scale,  agreeing  answers  were  scored  either  4  or  5, 
neutral  answers  were  scored  a  3,  and  disagreeing  answers 
were  scored  either  a  1  or  2.  Dashes  are  used  in  the  table 
to  indicate  where  no  response  was  recorded. 

TABLE  9 

SURVEY  ANALYSIS  BY  RESPONSE  TYPE 


SAMPLE 


SURVEY 

SIZE 

X 

AGREE 

X  NEUTRAL 

XDISAGREF 

ITEM 

B. 

L  L 

B. 

L  L 

B.  L 

L 

B.  L 

X. 

A 

10 

10 

- 

— 

7 

7 

3 

3 

B 

li 

11 

7 

10 

2 

1 

2 

- 

C 

11 

11 

9 

11 

2 

- 

- 

- 

D 

11 

11 

7 

9 

2 

2 

2 

- 

E 

11 

11 

9 

11 

1 

- 

1 

- 

F 

11 

11 

7 

5 

2 

3 

2 

3 

G 

11 

11 

10 

11 

1 

- 

- 

- 

H 

11 

11 

11 

10 

- 

1 

- 

- 

I 

11 

11 

11 

11 

- 

- 

- 

- 

J 

11 

11 

7 

10 

4 

- 

- 

1 

L 

9 

9 

9 

9 

- 

- 

- 

- 

M 

10 

10 

8 

7 

2 

3 

- 

- 

N 

10 

10 

9 

9 

1 

1 

- 

- 

0 

10 

to 

l 

1 

2 

6 

7 

3 

P 

10 

10 

8 

10 

2 

- 

- 

- 

0 

10 

10 

8 

10 

1 

— 

1 

- 

B  =  Designator 

for 

the 

bottoa-up 

curriculua 

structure 

T  =  Designator 

for 

the 

top 

-down 

curriculua 

structure 

Three  areas  in  Table  9  are  of  particular  note.  First, 
survey  items  B  through  E  all  relate  to  attitudes  about  the 
structure  of  the  lessons.  Top-down  participants  agreed 
wore  often,  possibly  indicating  they  were  wore  comfortable 
and  felt  learning  was  easier  given  the  logic  of  their  lesson 
structure  coapared  to  their  bottoa-up  counterparts.  This  is 
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interesting  considering  thst  1)  the  Kruakal-Wallis  test 
froa  Table  7  indicated  the  perforiance  test  data  was  not 
significant,  and  2)  the  botton-up  participants  averaged 
slightly  higher  scores  than  top-down  counterparts. 

Second,  top-down  participants  generally  agreed  wore  with 
ltea  J,  which  stated  that  concepts  were  covered  in 
appropriate  detail  in  the  lesson.  This  is  noteworthy  for 
similar  reasons  as  pointed  out  in  the  preceding  paragraph, 
and  that  despite  this  the  bottoa-up  participants  did  as  well 
or  better  on  the  performance  test  than  their  counterparts. 

Finally,  when  asked  whether  they  would  have  learned  the 
aaterial  in  the  lesson  better  froa  a  paper  copy  (ltea  0), 
bottoa-up  participants  disagreed  over  two-to-one  compared  to 
their  top-down  counterparts.  While  this  feedback  could 
indicate  jow  respondents  would  feel  about  an  exact  paper 
copy  of  what  they  saw  on  their  monitors,  it  sight  also 
indicate  they  approved  of  the  CBI/bottoa-up  curriculum 
structure  foraat. 

Per f prgfl.n.fcj?.  Test  and  Course  Cpgplg.t lail  IllC  CPlPdrltOn 

The  following  analysis  was  done  to  determine  what 
effect,  if  any,  Bight  be  aeen  when  perforaance  test  aeasures 
were  collated  with  course  completion  tiaes.  Table  10 
suaaarizes  data  first  presented  in  Table  1  of  Chapter  IV. 
Here,  the  total  number  of  scores  in  relation  to  specified 
perforaance  test  and  course  coapletion  tine  ranges  are 
provided.  Aside  froa  a  possible  top-down  outlier  located  in 
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the  lowest  tiae  range,  the  bulk  of  the  placements  cluster  In 
the  sixteen  to  twenty-four  alnute  tiae  range  at  scores  which 
range  froa  60  to  100.  Much  like  the  Kruskal-Wallis  analyses 
discussed  earlier,  there  did  not  appear  to  be  any 
significant  patterns  within  this  comparison.  That  is,  it 
did  not  appear  that  participants  within  one  lesson  structure 
tended  to  score  in  one  performance  teat/coapletion  tiae  area 
signi f icantly  more  than  the  other  structure. 

TABLE  10 

PERFORMANCE  TEST  AND  COURSE  COMPLETION  TIME  ANALYSIS 


PERFORMANCE  TEST 

SCORING 

RANGE 

TIME  RANGE 

60 

-  69 

70 

-  79 

80 

-  89 

90 

-  100 

Clin) 

B. 

L  I 

& 

L  I 

& 

L  I 

fi. 

L  I 

13  -  15 

- 

- 

— 

— 

- 

- 

- 

l 

16  -  18 

- 

- 

- 

l 

1 

l 

2 

- 

19  -  21 

1 

1 

- 

- 

1 

2 

2 

2 

22  -  24 

- 

1 

1 

- 

- 

1 

1 

- 

25  -  27 

- 

- 

l 

- 

1 

- 

- 

1 

B  =  Designator  for  the  bottoa-up  curriculum  structure 
T  *  Designator  for  the  top-down  curriculum  structure 


The  final  chapter  presents  conclusions  which  can  be 
drawn  froa  the  results  and  analysis  presented  thus  far.  In 
addition,  recoaaendations  for  further  research  are  also 
provided . 
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'LL,.  Conclvlong  iM.  Becoiiendition» 


Introduction 

This  chapter  suiiarizes  the  conclusions  drawn  froa  the 

analysis  perforaed  in  the  previous  chapter,  in  effect 

answering  the  research  question  set  forth  in  Chapter  1. 

That  question,  restated  here,  is  as  follows: 

If  the  saae  body  of  content  is  arranged  in  a  top-down 
(deductive)  structure  and  a  bottoa-up  (inductive) 
structure  and  presented  to  students  by  coaputer-based 
instruction,  what  (if  any)  differences  occur  in  student 
learning  (aeasured  by  perforaance  testing),  in  course 
coapletion  tiae,  and  in  student  attitude  toward  the 
learning  experience? 

While  the  potential  existed  for  curriculua  structure  to 
have  aade  such  differences,  the  statistical  analysis  proved 
otherwise  for  the  body  of  aaterial  tested.  Several 
iaportant  conclusions  were  drawn  froa  this  fact. 

The  outcoae  alluded  to  in  the  previous  paragraph,  that 
inductive  and  deductive  structure  produced  slailar  results 
in  learning,  perforaance  tiae,  and  user  attitude,  is  the 
single  aost  iaportant  outcoae  of  this  research.  However, 
there  a ay  tiaes  when  one  or  another  of  the  three  variables 
(perforaance  test,  course  coapletion  tiae,  and  student 
attitude)  aay  be  aore  iaportant  to  an  educator,  in  which 
case  there  are  additional  inferences  which  can  be  aade. 

This  research  assuaes  that  ailltary  educators  are  aost 
interested  in  those  techniques  which  produce  the  highest 


degree  of  learning  perforaance  for  their  atudenta.  This 
iaplies,  then,  that  course  coapletion  tiaes  and  student 
attitudes,  though  iaportant,  play  a  secondary  role  to 
student  perforasnce.  Applying  that  criterion  and  the 
results  of  this  research  leads  one  to  conclude  that  the 
bottoa-up  approach  has  a  slight  advantage  over  top-down 
structure.  However,  an  educator  aay  want  to  consider  all 
three  variables,  using  one  variable  as  the  prlaary  objective 
with  the  other  two  of  lesser  (but  still  essential) 
iaportance.  If  such  an  approach  is  applied  in  instances 
where  (as  in  this  research)  students  are  unfaailiar  with  the 
CBI  learning  aaterial,  then  conclusions  froa  the  following 
"if-thenH  scenarios,  which  this  research  supports,  are 
approaches  educators  aay  want  to  consider. 

Scenario  1: 

IF  student  perforaance  is  of  prlaary 
lap  ortance-- 

AID  IF  course  coapletion  tiae  is  of 
lesser  iaportance — 

AND  IF  student  attitude  is  of  least 
iaportance-- 

IHEN  the  bottoa-up  curriculua  structure 
is  the  aethod  of  choice. 

This  conclusion  is  based  heavily  on  perforaance  test 
results,  outweighing  the  evidence  which  indicated  that 
average  course  coapletion  tiaes  for  the  top-down  structure 
were  lower  than  those  for  the  bottoa-up  structure.  This 
tiae  difference  was  a  aere  1.18  alnutes;  a  result  that  could 
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be  partially  due  to  the  one  ainute  increaents  uaed  to 
docuaent  the  coapletion  tinea.  Further,  it  is  difficult  to 
place  auch  eaphasis  on  any  tiae  advantage  because  the 
bottoa-up  leaaon  was  13.2*  longer  than  the  top-down  lesson. 
Scenario  2: 

IF  student  perforaance  is  of  priaary 
iaportance — 

AMD  IF  student  attitude  is  of  lesser 
iaportance-- 

AND  IF  course  coapletion  is  of  least 
iaportance-- 

THEN  the  bottoa-up  curriculua  structure 
is  the  aethod  of  choice. 

While  the  perforaance  test  result  was  the  strongest 
factor  affecting  this  conclusion,  another  factor  which 
supported  it  was  the  attitude  survey  result  which  Indicated 
that  bottoa-up  participants,  by  a  aargin  of  over  two-to-one 
over  top-down  participants,  disagreed  with  the  stateaent 
that  they  would  have  learned  the  lesson  better  froa  a  paper 
copy.  This  aay  be  an  iaportant  realization  for  CBI 
designers.  However,  when  student  attitude  is  the  variable 
of  priaary  iaportance,  and  other  key  attitude  survey  results 
are  considered,  a  different  conclusion  is  warranted,  as  seen 
by  the  following  scenario. 
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Scenario  3: 

IF  student  attitude  is  of  priaary 
iaportance — 

AMD  IF  student  perforaance  is  of  lesser 
iaportance-- 

AMD  IF  course  coapletion  tiaes  are  of 
least  iaportance-- 

THEN  the  top-down  curriculua  structure 
is  the  aethod  of  choice. 

While  the  bottoa-up  participants  Indicated,  by  the  two- 
to-one  margin  referenced  earlier,  that  they  would  not  have 
learned  the  lesson  better  froa  a  paper  copy,  the  top-down 
participants  gave  the  strongest  indications  that  they  were 
generally  aore  coafortable  with  the  lesson,  and  felt  they 
learned  better,  than  those  students  randoaly  assigned  to  the 
bottoa-up  lesson.  In  addition,  the  average  results  within 
each  structure  for  either  the  perforaance  test  (student 
learning)  or  course  coapletion  tlae  were  so  close  that  the 
investigator  felt  they  becoae  non-players  when  student 
attitude  is  the  prlaary  educstlonal  objective. 

The  previous  scenarios  are  obviously  not  aeant  to  be 
exhaustive  in  nature,  but  are  provided  as  a  guide  which  the 
reader  can  use  to  deteraine  an  appropriate  curriculua 
structure  for  a  nuaber  of  different  applications.  The 
recoaaendations  of  the  following  paragraph s  are  an  outgrowth 
of  those  scenarios. 
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Recoaaendations 


The  coaaents  provided  by  participants  as  part  of  their 
attitude  survey  responses  indicate  that  an  ability  to  back¬ 
track  through  previously  covered  aaterial  would  have 
iaproved  the  CBI  lessons.  For  obvious  reasons,  this 
research  design  could  not  perait  backtracking  since  this 
would  allow  participants  to  restructure  the  aaterial,  when 
the  "structure"  of  the  aaterial  was  the  Independent  variable 
being  tested.  In  addition,  participants  indicated  that 
highlighting  of  aain  concepts  would  have  also  been  an 
iaproveaent.  This  research  did  not  use  highlighting  because 
of  the  unknown  effect  it  alght  have  if  not  equally  applied 
to  both  structures.  As  this  feedback  suggests,  educators 
should  aake  a  note  to  include  these  aspects  in  their  CBI 
when  possible.  Had  such  prograa  design  aspects  been 
possible,  participants  using  each  structure  alght  have  been 
even  aore  coafortable  with  their  randoaly  assigned  lesson 
structure . 

As  Chapter  III  pointed  out,  the  bottoa-up  prograa  was 
physically  13. 2X  longer  than  its  top-down  counterpart.  This 
difference  in  length  is  due  to  the  essence  of  the  bottoa-up 
structure,  which  relies  aore  on  exaaples  in  leading  the 
student  toward  generalizations  and  rules  of  behavior.  The 
full  effect  of  this  difference  in  prograa  length  could  have 
caused  not  only  the  differences  seen  in  average  course 
coapletion  tiae,  but  alght  have  affected  the  other 
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performance  measures  as  well.  Judgments  about  such  effects 
are  beyond  the  scope  of  this  CBI  research,  suggesting  an 
area  where  further  investigation  should  be  performed. 

Finally,  this  research  was  designed  for  participants 
with  little  knowledge  about  the  CBI  course  content.  As  the 
results  Indicate,  no  statistically  significant  differences 
were  found  which  suggest  that  one  curriculum  structure 
promotes  different  (better  or  worse)  measurements  in 
comparison  with  the  other.  It  would  be  valuable  to  know 
what  results  would  be  obtained  for  situations  where  the 
participants  already  had  a  depth  of  knowledge  from  which  to 
work.  In  a  similar  vein,  it  would  also  be  valuable  to 
determine  if  the  conclusions  of  this  research  apply  to 
learning  applications  at  other  than  the  "knowledge"  level. 
The  investigator  recommends  further  work  in  these  areas  as  a 
continuance  of  ongoing  efforts  to  help  educators  design  and 
use  computer-based  Instruction  with  maximum  effectiveness. 

Sviiary 

The  differences  caused  by  top-down  (deductive)  and 
bottom-up  (inductive)  curriculum  structures  were  not 
statistically  significant  in  this  research.  This  provides 
educators  an  Important  result  in  that  either  structure  has 
been  shown  effective  when  the  following  learning  variables 
are  measured:  performance  (amount  of  learning),  the  amount 
of  time  to  complete  the  learning  session,  and  student 
attitude  about  the  learning  experience. 
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However,  educators  say  have  their  own  agenda  as  to  which 
of  the  three  reaearch  variables  are  most  important.  For 
this  reason  several  Mif-thenM  scenarios  are  diacussed  to  aid 
educators  in  selecting  the  best  structure  for  their 
particular  application. 
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10  REM  THIS  IS  THE  T0P-D0HN  PR06RAM  STRUCTURE 
20  KEY  OFF 
30  COLOR  14,1 
40  CLS 
50  PRINT 

60  PRINT’  INTRODUCTION* 

70  PRINT 
80  PRINT 
90  COLOR  15,1 

100  PRINT*  ttelcoae  to  this  presentation  on  government  contracting.* 

110  PRINT*  The  eater ial  you  are  about  to  review  is  based  on  subject* 

120  PRINT*  eatter  extracted  froa  the  Federal  Acquisition  Regulation* 

130  PRINT*  (FAR)  and  AFIT  course  CH6T  523,  Contracting  and  Acquisition* 

140  PRINT*  Management.  This  material  uas  chosen  not  only  for  its* 

150  PRINT*  interest  to  AF  managers  but  for  its  relevance  to  your* 

160  PRINT*  career  field  in  particular.  There  are  three  parts  to* 

170  PRINT*  this  presentation:* 

180  PRINT 

190  PRINT*  1.  The  text  portion  using  computer-assisted* 

200  PRINT*  instruction  (following  these  introductions),* 

210  PRINT 

220  PRINT*  2.  A  written  quiz  (in  the  envelope  beside  your* 

230  PRINT*  computer)  over  the  learning  material  in  step  1,' 

240  PRINT 

250  PRINT*  3.  A  brief  survey,  following  the  written  quiz,  to* 

260  PRINT*  ask  for  your  feedback  on  this  presentation.* 

270  PRINT 

280  INPUT*  To  continue,  press  <ENTER>*,P 

290  CLS 

300  PRINT 

310  PRINT 

320  PRINT 

330  PRINT 

340  PRINT*  The  computer  program  itself  is  written  like  a  text,  but* 

350  PRINT*  with  a  SELF-TEST  QUESTION  occasionally  inserted  to  help* 

360  PRINT*  you  reinforce  main  points.  These  questions,  displayed* 

370  PRINT*  with  the  same  blue  background  you  see  here  but  with  light* 

380  PRINT*  blue  text  writing,  will  also  give  you  a  good  idea  of  what’ 

390  PRINT*  to  expect  from  the  short  quiz  you  will  complete  at  the* 

400  PRINT*  conclusion  of  this  computer  portion  of  the  exercise.' 

410  PRINT 

420  PRINT*  Your  participation  in  this  review  is  greatly  appreciated.* 

430  PRINT*  Though  your  progress  through  the  .<\t  portion  will  be* 

440  PRINT*  timed,  please  work  at  a  pace  which  is  comfortable  to  you.' 

450  PRINT*  This  is  not  a  competition  to  see  who  finishes  first.’ 

460  PRINT 

470  PRINT*  THANK  YOU  in  advance  for  your  efforts  and  feedback* 

480  PRINT*  during  this  exercise.' 

490  PRINT 


500  HINT 
510  PRINT 
520  INPUT* 

530  CLS 
540  PRINT 
550  PRINT 
560  COLOR  14,1 
570  PRINT* 

560  PRINT 
590  COLOR  15,1 
600  PRINT* 

610  PRINT* 

620  PRINT* 

630  PRINT* 

640  PRINT* 

650  PRINT 
660  PRINT- 
670  PRINT* 

6B0  PRINT* 

690  PRINT* 

700  PRINT* 

710  PRINT 
720  PRINT- 
730  PRINT- 
740  PRINT- 
750  PRINT* 

760  PRINT 
770  PRINT 
780  INPUT- 
790  CLS 
800  PRINT 
810  PRINT 
820  PRINT 
830  PRINT 
840  COLOR  14,1 
850  PRINT* 

860  PRINT 
870  PRINT 
880  COLOR  15,1 
890  PRINT* 

900  PRINT- 
910  PRINT* 

920  PRINT* 

930  PRINT* 

940  PRINT* 

950  PRINT* 

960  PRINT 
970  PRINT- 
980  PRINT 
990  PRINT- 
1000  PRINT 
1010  PRINT 


To  continue,  press  (ENTER)', P 


Contract  Administration* 


Contract  adainistration  contains  aany  activities,* 
including  those  associated  with  assuring  the  governaent* 
gets  what  it  is  entitled  to  under  the  teras  of  a  contract.* 
duality  assurance  aeasures  are  a  priaary  means  of  making  * 
this  happen.* 

Quality  assurance  in  governaent  procurement  is  achieved* 
through  both  inspection  and  uarranty  provisions  set  forth* 
in  governaent  contracts.  Each  of  these  provisions  plays* 
an  iaportant  part  in  the  quality  process  at  specific  points' 
in  the  life  cycle  of  the  contract.* 

Inspections  are  carried  out  prior  to  governaent* 
acceptance  of  the  good  or  service  contracted.  Warranties' 
provide  protection  after  acceptance.  We’ll  discuss* 
inspections  first,  and  then  warranties.* 


To  continue,  press  (ENTER)*, P 


Inspections' 


The  priaary  guidance  for  inspection  activities  is  the* 
Federal  Acquisition  Regulation  (FAR).  In  a  large  sense,* 
inspections  provide  the  governaent  its  earliest  opportunity* 
to  evaluate  a  contractor's  performance.  As  a  result,* 
inspections  are  considered  the  governaent’s  priaary  Beans* 
of  ensuring  quality.  The  intensity  of  an  inspection* 
prograa  depends  on  two  things:* 

1.  the  contractor  involved  in  the  procureaent,  and* 

2.  the  nature  of  the  procured  itea  (complexity,  etc.)* 
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1020  PRINT 
1030  PRINT 
1040  INPUT* 

1050  as 

1060  PRINT 
1070  PRINT 
1080  PRINT 
1080  PRINT 
1100  PRINT* 
1110  PRINT* 
1120  PRINT* 
1130  PRINT* 
1140  PRINT* 
1150  PRINT* 
1160  PRINT 
1170  PRINT* 
1160  PRINT* 
1190  PRINT* 
1200  PRINT 
1210  PRINT* 
1220  PRINT* 
1230  PRINT 
1240  PRINT 
1250  PRINT 
1260  PRINT 
1270  PRINT 
1280  INPUT- 
1290  PRINT 

1300  as 

1310  PRINT 
1320  PRINT 
1330  PRINT 
1340  PRINT 
1350  PRINT 
1360  PRINT 
1370  PRINT* 
1380  PRINT* 
1390  PRINT* 
1400  PRINT 
1410  PRINT- 
1420  PRINT* 
1430  PRINT 
1440  PRINT* 
1450  PRINT 
1460  PRINT- 
1470  PRINT* 
1480  PRINT 
1490  PRINT 
1500  PRINT 
1510  PRINT 
1520  PRINT 
1530  INPUT* 


To  continue,  press  <ENTER>*,P 


Although  the  government  retains  the  right  to  determine* 
the  nature  of  its  quality  assurance  prograts,  the  FAR* 
stipulates  that  the  government  shall  rely  on  the* 
contractor  to  perform  all  necessary  inspections  and  tests.* 
The  exceptions  to  this  rule,  as  deemed  necessary  by  the* 
contracting  officer,  can  occur  at  either  of  the  following:* 

1.  any  time  the  when  government  has  a  need  to  perform* 
such  activities  to  check  the  contractor's  internal* 
work  processes,  or* 

2.  in  advance  of  accepting  the  contractor's  offer  of* 
the  final  product.' 


To  continue,  press  <ENTER>*,P 


The  FAR  defines  general  inspection  guidelines  which* 
apply  to  all  contract  categories,  as  well  as  specific* 
guidelines  for  different  contract  types.' 

The  general  guidelines  are  discussed  below,  in  two* 
categories:' 

1.  the  government’s  rights,  and* 

2.  requirements  levied  on  the  contractor  by  the* 
government.* 


To  continue,  press  <ENTER)',P 
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SELF-TEST  QUESTION1 


1540  COLOR  11,1 

1550  as 

1560  PRINT 
1570  COLOR  14,1 
1580  PRINT’ 

1500  COLOR  11,1 
1600  PRINT 
1610  PRINT 

1620  PRINT*  Before  continuing,  indicate  your  answer  to  the  following.* 
1630  PRINT 
1640  PRINT 

1650  PRINT*  Without  exception,  the  FAR  requires  a  contractor  to* 

1660  PRINT*  perfora  all  necessary  inspection  activities.* 

1670  PRINT 

1680  PRINT*  a.  True* 

1690  PRINT*  b.  False* 

1700  PRINT 
1710  PRINT 

1720  INPUT*  Select  a  or  b,  and  press  <ENTER>  *,A* 

1730  IF  A4=*A*  THEN  1840 
1740  IF  Al=*a*  THEN  1840 
1750  IF  Al=*8*  THEN  1810 
1760  IF  Al=*b*  THEN  1810 
1770  PRINT 
1780  PRINT 

1790  PRINT*  CAP*)  is  not  a  choice.  Try  again.* 

1800  GOTO  1710 
1810  PRINT 

1820  PRINT*  Correct.  Let's  continue.* 

1830  GOTO  1890 
1840  PRINT 

1850  PRINT*  Incorrect.  The  correct  answer  is  B.  The  FAR  provides* 

1860  PRINT*  contracting  officers  with  several  exceptions' 

1870  PRINT*  to  the  general  guidance  that  a  contractor* 

1880  PRINT*  per  fore  all  inspections  and  tests.* 

1890  PRINT 

1900  INPUT*  To  continue,  press  <ENTER>',P 

1910  COLOR  14,1 

1920  as 

1930  PRINT 
1940  PRINT 
1950  PRINT 
1960  PRINT 

1970  PRINT*  6overneent  Inspection* 

1980  COLOR  15,1 
1990  PRINT 
2000  PRINT 

2010  PRINT*  The  FAR  requires  the  contractor  to  provide  and* 

2020  PRINT*  aaintain  an  inspection  systee  acceptable  to  the  governaent.' 
2030  PRINT*  Additionally,  the  governaent  retains  the  right  to  inspect* 

2040  PRINT*  and  test  the  procured  itea/s  called  out  in  the  contract  to* 

2050  PRINT*  the  extent  practicable.  However,  this  does  not  give  the* 
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2060 

PRINT* 

2070 

PRINT* 

2080 

PRINT* 

2080 

PRINT* 

2100 

PRINT* 

2110 

PRINT 

2120 

PRINT 

2130 

PRINT 

2140 

PRINT 

2150 

PRINT 

2160 

INPUT* 

2170 

CIS 

2180 

PRINT 

2190 

PRINT 

2200 

PRINT 

2210 

PRINT 

2220 

.  2INT 

2230 

COLOR  14,1 

2240 

PRINT* 

2250 

COLOR  15,1 

2260 

PRINT 

2270 

PRINT 

2280 

PRINT* 

2290 

PRINT- 

2300 

PRINT* 

2310 

PRINT- 

2320 

PRINT* 

2330 

PRINT- 

2340 

PRINT* 

2350 

PRINT- 

2360 

PRINT* 

2370 

PRINT 

2380 

PRINT 

2390 

PRINT 

2400 

PRINT 

2410 

PRINT 

2420 

INPUT* 

2430 

CLS 

2440 

PRINT 

2450 

PRINT 

2460 

PRINT 

2470 

PRINT 

2480 

PRINT 

2490 

PRINT* 

2500 

PRINT- 

2510 

PRINT* 

2520 

PR!NT 

2530 

PRINT* 

2540 

PRINT* 

2550 

PRINT* 

2560 

PRINT* 

2570 

PRINT* 

government  free  reign  to  do  whatever  it  pleases.  Three* 
areas  of  concern  to  be  considered  as  the  government  plans* 
its  inspection  activities  are  time,  place,  and  costs  of 
inspection.  Let's  consider,  separately,  the  ramifications' 
of  each.' 


To  continue,  press  (ENTER)*, P 


Time  of  Inspection* 


Uhile  the  FAR  offers  the  government  flexibility  by* 
suggesting  it  can  inspect  at  all. ..times,  including  the* 
period  of  manufacture,  and  in  any  event  before  acceptance,* 
it  also  opens  the  door  for  potential  liabilities.  Such  is* 
the  case  if  the  contractor  is  caused  undue  or  unreasonable* 
delay.  Fortunately,  the  courts  do  not  deem  all  delays* 
unreasonable;  contractors  must  anticipate  some* 
inspection-related  delays  during  the  preparation  of  their* 
contract  proposals.* 


To  continue,  press  (ENTER)*, P 


Also,  while  the  FAR  indicates  inspection  will,  in* 
general,  take  place  prior  to  government  acceptance,  a* 
provision  for  Certificate  of  Conformance  nay  be  applied.* 
Such  a  certificate  is  offered  by  the  contractor  to  the* 
government  (like  a  guarantee  of  quality)  and  can  be  used* 
as  the  government's  sole  consideration  for  acceptance.' 
Certificate's  of  Conformance  are  usually  only  considered* 
appropriate  in  those  situations  where  either  small  losses* 
would  be  incurred  or  the  contractor’s  reputation  and  past* 
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2580  PRINT* 

perforeance  warrant  such  an  award.  However,  even  if  this* 

2590  PRINT* 

certificate  is  used,  the  government  still  reserves  the* 

2600  PRINT* 

right  to  inspect.* 

2610  PRINT 

2620  PRINT 

2630  PRINT 

2640  PRINT 

2650  PRINT 

2660  INPUT* 

To  continue,  press  <ENTER>*,P 

2670  CLS 

2680  PRINT 

2690  PRINT 

2700  PRINT 

2710  COLOR  14,1 

2720  PRINT* 

Place  of  Inspection* 

2730  PRINT 

2740  PRINT 

2750  COLOR  15, 1 

2760  PRINT* 

In  general,  the  contract  should  indicate  the  location* 

2770  PRINT* 

of  inspections.  The  FAR  offers  five  recoaaendations  the* 

2780  PRINT* 

governaent  should  consider  when  choosing  a  location.  The* 

2790  PRINT* 

location  is  suitable-*' 

2600  PRINT 

2810  PRINT* 

a.  if  use  of  any  another  place  would  cause* 

2820  PRINT* 

uneconoaicai  disassembly  or  destructive  testing,* 

2830  PRINT 

2840  PRINT* 

b.  if  considerable  loss  would  result  froa  Baking  and* 

2850  PRINT* 

shipping  unacceptable  products,' 

2860  PRINT 

2870  PRINT* 

c.  if  special  instruaents,  facilities,  etc.,  are* 

2880  PRINT* 

available  only  at  the  source,' 

2890  PRINT 

2900  PRINT 

2910  PRINT 

2920  INPUT* 

To  continue,  press  (ENTER)', P 

2930  CLS 

2940  PRINT 

2950  PRINT 

2960  PRINT 

2970  PRINT 

2980  PRINT 

2990  PRINT 

3000  PRINT 

301V  PRINT 

3020  PRINT 

3030  PRINT* 

d.  if  governaent  inspection  during  contract* 

3040  PRINT* 

perforaance  is  deemed  essential,  or* 

3050  PRINT 

3060  PRINT* 

e.  if,  for  any  other  reasons,  it  is  seen  as  in  the* 

3070  PRINT* 

best  interests  of  the  governaent.' 

3080  PRINT 

3090  PRINT 
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To  continue,  press  <ENTER>',P 


3100  PRINT 
3110  PRINT 
3120  PRINT 
3130  PRINT 
3140  PRINT 
3150  PRINT 
3160  INPUT* 
3170  CIS 
3180  COLOR  14,1 
3190  PRINT 
3200  PRINT 
3210  PRINT 
3220  PRINT 
3230  PRINT 
3240  PRINT 
3250  PRINT* 

3260  COLOR  15,1 
3270  PRINT 
3280  PRINT 
3290  PRINT* 

3300  PRINT* 

3310  PRINT* 

3320  PRINT* 

3330  PRINT* 

3340  PRINT* 

3350  PRINT* 

3360  PRINT 
3370  PRINT 
3380  PRINT 
3390  PRINT 
3400  PRINT 
3410  PRINT 
3420  INPUT* 

3430  COLOR  11,1 
3440  CLS 
3450  PRINT 
3460  COLOR  14,1 
3470  PRINT* 

3480  COLOR  11,1 
3490  PRINT 
3500  PRINT 
3510  PRINT* 

3520  PRINT 
3530  PRINT 
3540  PRINT* 

3550  PRINT 
3560  PRINT 
3570  PRINT* 

3580  PRINT* 

3590  PRINT* 

3600  PRINT 
3610  PRINT 


Costs  of  Inspection* 


If  inspection  is  performed  at  the  contractor's  or* 
subcontractor's  premises,  the  contractor  will  provide* 
facilities  and  assistance  without  additional  charge.  If* 
inspection  is  conducted  at  other  than  contractor  preaises,' 
the  government  bears  the  expense.  The  saae  applies  if  the* 
government  requires  special  inspection  equipment,* 
regardless  of  where  the  inspection  occurs.* 


To  continue,  press  (ENTER)*, P 


SELF-TEST  QUESTION* 


Complete  the  following  statement.* 


A  Certificate  of  Conformance  is  submitted  by:* 


a.  the  contracting  officer.* 

b.  the  contractor.' 

c.  either  a  or  b,  depending  upon  the  circumstance.* 
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3620  INPUT*  Select  a,  b,  or  c,  and  press  (ENTER)  *,A* 

3630  IF  A0=*A*  THEN  3760 

3640  IF  A*»*a*  THEN  3760 

3650  IF  Ai=*B*  THEN  3730 

3660  IF  A«**b*  THEN  3730 

3670  IF  AI=*C*  THEN  3760 

3680  IF  Al**c*  THEN  3760 

3690  PRINT 
3700  PRINT 

3710  PRINT*  (*A$*)  is  not  a  choice.  Try  again.* 

3720  SOTO  3610 
3730  PRINT 

3740  PRINT*  Correct.  Let's  continue.* 

3750  GOTO  3800 
3760  PRINT 

3770  PRINT*  Incorrect.  The  correct  answer  is  B.  The  contractor* 

3780  PRINT*  subeits  a  Certificate  of  Conforaance  for  the* 

3790  PRINT*  governaent's  consideration.' 

3800  PRINT 

3810  INPUT*  To  continue,  press  (ENTER)* ,P 

3820  COLOR  14,1 
3830  CLS 
3840  PRINT 

3850  PRINT*  Contractor  Responsibility* 

3860  PRINT 
3870  PRINT 
3880  COLOR  15,1 

3890  PRINT*  In  addition  to  establishing  governaent  inspection* 

3900  PRINT*  rights,  the  FAR  requires  contractors  to  provide  and* 

3910  PRINT*  aaintain  an  inspection  systea  acceptable  to  the’ 

3920  PRINT*  governaent.  It  further  requires  contractors  to:* 

3930  PRINT 

3940  PRINT*  1.  control  the  quality  of  their  supplies  and  services,' 

3950  PRINT 

3960  PRINT*  2.  tender  for  acceptance  only  supplies  and  services* 

3970  PRINT*  which  confora  to  contract  requireaents,' 

3980  PRINT 

3990  PRINT*  3.  ensure  vendors  have  adequate  quality  control,  and* 

4000  PRINT 

4010  PRINT*  4.  aaintain  records  of  inspection  activities  which* 

4020  PRINT*  evidence  the  fact  that  supplies  and  services' 

4030  PRINT*  confora  to  the  contract,  and  furnish  the* 

4040  PRINT*  governaent  such  inforsation  as  required.' 

4050  PRINT 

4060  INPUT*  To  continue,  press  (ENTER)', P 

4070  COLOR  11,1 

4080  CIS 

4090  PRINT 

4100  COLOR  14,1 

4110  PRINT*  SELF-TEST  BUESTI0N* 

4120  COLOR  11,1 
4130  PRINT 
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Indicate  your  answer  to  the  following. 


4140  PRINT 
4150  PRINT' 

4160  PRINT 
4170  PRINT 

4180  PRINT*  The  FAR  specifies  that  a  contractor  Bust  only  subait' 

4190  PRINT*  products  which  confora  to  contract  requireaents.* 

4200  PRINT 

4210  PRINT*  a.  True* 

4220  PRINT*  b.  False* 

4230  PRINT 
4240  PRINT 

4250  INPUT*  Select  a  or  b,  and  press  <ENTER>  *,A$ 

4260  IF  At»*A*  THEN  4340 
4270  IF  A*=*a*  TON  4340 
4280  IF  At=*B*  THEN  4370 
4290  IF  Al=*b*  THEN  4370 
4300  PRINT 
4310  PRINT 

4320  PRINT*  (*A$*)  is  not  a  choice.  Try  again.' 

4330  60T0  4240 
4340  PRINT 

4350  PRINT*  Correct.  Let's  continue.' 

4360  GOTO  4410 
4370  PRINT 

4380  PRINT*  Incorrect.  The  correct  answer  is  A.  The  FAR  aandates* 

4390  PRINT*  that  a  contractor  only  subait  products  which* 

4400  PRINT*  confora  to  the  requireaents  of  the  contract.’ 

4410  PRINT 

4420  INPUT*  To  continue,  press  (ENTER)', P 

4430  COLOR  15,1 

4440  CLS 

4450  PRINT 

4460  PRINT 

4470  PRINT 

4480  PRINT 

4490  PRINT 

4500  PRINT 

4510  PRINT 

4520  PRINT 

4530  PRINT*  Should  a  contractor’s  systea  of  inspection  fail  to* 

4540  PRINT*  screen  out  defective  iteas  or  practices,  the  courts  have* 

4550  PRINT*  ruled  that  the  governaent  has  the  right  to  decline  further* 

4560  PRINT*  inspections.  However,  governaent  actions  to  reject  the* 

4570  PRINT*  contractor's  perforaance  Bust  follow  specific  guidelines.' 
4580  PRINT 
4590  PRINT 


4600  PRINT 
4610  PRINT 


4620  PRINT 


4630  PRINT 


4640  PRINT 
4650  PRINT 
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To  continue,  press  <ENTER>',P 


4660  PRINT 
4670  INPUT* 

4690  CLS 
4690  COLOR  14,1 
4700  PRINT 
4710  PRINT 
4720  PRINT 
4730  PRINT 
4740  PRINT 
4750  PRINT 
4760  PRINT* 

4770  COLOR  15,1 
4790  PRINT 
4790  PRINT 
4800  PRINT* 

4810  PRINT* 

4820  PRINT* 

4830  PRINT* 

4840  PRINT 
4850  PRINT- 
4860  PRINT' 

4870  PRINT* 

4880  PRINT 
4890  PRINT 
4900  PRINT 
4910  PRINT 
4920  PRINT 
4930  INPUT* 

4940  CLS 
4950  PRINT 
4960  PRINT 
4970  PRINT 
4980  PRINT 
4990  PRINT 
5000  PRINT* 

501C  PRINT 
5020  PRINT* 

5030  PRINT* 

5040  PRINT* 

5050  PRINT* 

5060  PRINT- 
5070  PRINT* 

5080  PRINT* 

5090  PRINT* 

5100  PRINT* 

5110  PRINT* 

5120  PRINT 
5130  PRINT 
5140  PRINT 
5150  PRINT 
5160  PRINT 
5170  INPUT* 


Rejection  and  Correction* 


A  contractor's  work  may  be  rejected  if  it  does  not* 
coaply  with  the  government's  specifications.  There  are  six' 
key  points  about  rejecting  supplies  and  services  which* 
apply  to  governaent  contracts;' 

1.  Nonconformance  most  often  results  in  rejection  when* 
perforaance,  durability,  operational  effectiveness,' 
appearance,  or  weight  have  been  adversely  affected.* 


To  continue,  press  <ENTER>',P 


2.  The  contractor  aust  be  given  tiaely  notice.* 

Obviously  this  can  mean  a  lot  of  things,  but* 
the  bottoa  line  is  that  as  soon  as  the  governaent* 
knows  it  intends  to  reject,  it  should  infora  the* 
contractor.  Otherwise,  an  iaplied  acceptance  on* 
the  part  of  the  governaent  can  result.  Consider* 
the  case  where  the  governaent  iaplicitiy  accepted* 
almost  36,000  eggs  because  it  retained  then  for* 
more  than  two  aonths  after  inspection  had  been* 
perforaed  without  communication  of  a  rejection  to* 
the  contractor.* 


To  continue,  press  <ENTER>*,P 
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5190  as 
5190  PRINT 
5200  PRINT* 
5210  PRINT* 
5220  PRINT* 
5230  PRINT* 
5240  PRINT* 
5250  PRINT* 
5260  PRINT* 
5270  PRINT 
5280  PRINT* 
5290  PRINT* 
5300  PRINT* 
5310  PRINT* 
5320  PRINT* 
5330  PRINT* 
5340  PRINT* 
5350  PRINT* 
5360  PRINT* 
5370  PRINT* 
53B0  PRINT* 
5390  PRINT 
5400  PRINT 
5410  INPUT* 
5420  CLS 
5430  PRINT 
5440  PRINT 
5450  PRINT 
5460  PRINT* 
5470  PRINT* 
5480  PRINT* 
5490  PRINT* 
5500  PRINT" 
5510  PRINT* 
5520  PRINT* 
5530  PRINT* 
5540  PRINT* 
5550  PRINT* 
5560  PRINT* 
5570  PRINT 
5580  PRINT* 
5590  PRINT* 
5600  PRINT* 
5610  PRINT* 
5620  PRINT 
5630  PRINT 
5640  PRINT 
5650  INPUT* 
5660  COLOR  11,1 
5670  CLS 
5680  PRINT 
5690  COLOR  14,1 


3.  The  FAR  requires  the  government  to  iitclude  reasons* 
for  its  rejection  when  it  notifies  the  contractor.* 
The  government's  notification  need  not  be  in* 
writing  unless  the  rejection  is  conaunicated  at  a* 
place  other  than  the  contractor's  facilities,  or  if* 
the  contractor  continues  to  subeit  nonconforeing* 
supplies  or  services.* 

4.  Two  options  are  available  to  the  government  in  the* 
event  the  contractor's  product  is  found  to  be* 
defective.  First,  if  the  defects  appear  to  be 
repairable  within  the  noraal  contract  period,  the* 
government  must  allow  the  contractor  the* 
opportunity  to  aake  such  corrections.  In  addition,' 
if  a  defect  is  relatively  ainor  and  the  contractor* 
delivered  ahead  of  schedule  believing  the  product* 
would  be  accepted,  it  oust  be  given  a  reasonable* 
aaount  of  time  past  the  delivery  date  to  aake 
corrections.* 


To  continue,  press  <ENTER>*,P 


5.  If  final  inspection  is  perforaed  (per  the  contract)' 
at  a  government  facility,  government  rejection* 
would  require  the  contractor  to  reaove  the* 
defective  product  unless  authorized  to  coaplete* 
corrections-in-place.  If  rejected  iteas  are  not* 
reaoved  promptly  the  government  can  terminate  the’ 
contract  (unlikely  in  most  situations)  or  remove,* 
replace,  or  repair  the  item  at  the  contractor's* 
expense.  However,  termination  only  applies  if  the* 
defects  are  judged  not  repairable  within  the* 
delivery  schedule  specified  by  the  contract.' 

6.  Should  the  government  decide  to  accept  defective* 
goods  or  services  (which  it  can  do  in  its  own  best’ 
interest),  it  can  require  an  equitable  price* 
reduction  from  the  contractor.' 


To  continue,  press  (ENTER)’, P 
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5700  PRINT* 

SELF-TEST  QUESTION* 

5710  COLOR  llfl 

5720  PRINT 

5730  PRINT 

5740  PRINT* 

Indicate  your  answer  to  the  following.* 

5750  PRINT 

5760  PRINT 

5770  PRINT* 

A  contractor  can  be  authorized  tine  beyond  the  delivery* 

5780  PRINT* 

date  to  take  corrections  to  a  product.' 

5790  PRINT 

5800  PRINT* 

a.  True* 

5810  PRINT* 

b.  False* 

5820  PRINT 

5830  PRINT 

5840  INPUT* 

Select  a  or  b,  and  press  <ENTER>  *,A$ 

5850  IF  At=*A* 

THEN  5930 

5860  IF  A<=*a* 

THEN  5930 

5870  IF  A$**8* 

THEN  5960 

5880  IF  A4=*b* 

THEN  5960 

5890  PRINT 

5900  PRINT 

5910  PRINT* 

CAI*)  is  not  a  choice.  Try  again.' 

5920  GOTO  5830 

5930  PRINT 

5940  PRINT* 

Correct.  Let's  continue.* 

5950  GOTO  6030 

5960  PRINT 

5970  PRINT* 

Incorrect.  The  correct  answer  is  A.  If  the  contractor* 

5980  PRINT* 

delivers  ahead  of  schedule  and  reasonably* 

5990  PRINT* 

believes  the  product  will  be  accepted,  yet* 

6000  PRINT* 

•inor  defects  are  found,  it  eust  be  authorized 

6010  PRINT* 

tise  beyond  the  contract  date  to  take’ 

6020  PRINT* 

corrections.* 

6030  PRINT 

6040  INPUT* 

To  continue,  press  <ENTER>*,I 

6050  COLOR  15, 1 

6060  CLS 

6070  PRINT 

6080  PRINT 

6090  PRINT 

6100  PRINT 

6110  PRINT 

6120  PRINT 

6130  PRINT 

6140  PRINT 

6150  PRINT 

6160  PRINT* 

Nov  let’s  assuee  the  government  and  contractor* 

6170  PRINT* 

are  progressing  with  a  satisfactory  inspection  progras,* 

6180  PRINT* 

and  both  sides  are  ready  for  final  inspection  and* 

6190  PRINT* 

acceptance  under  teres  of  the  contract.* 

6200  PRINT 

6210  PRINT 
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To  continue,  press  <ENTER>‘,P 


6220  PRINT 
6230  PRINT 
6240  PRINT 
6250  PRINT 
6260  PRINT 
6270  PRINT 
6280  PRINT 
6280  INPUT* 

6300  as 
6310  COLOR  14,1 
6320  PRINT 
6330  PRINT 
6340  PRINT 
6350  PRINT 
6360  PRINT 
6370  PRINT- 
6380  COLOR  15,1 
6390  PRINT 
6400  PRINT 
6410  PRINT- 
6420  PRINT- 
6430  PRINT- 
6440  PRINT- 
6450  PRINT- 
6460  PRINT- 
6470  PRINT- 
6480  PRINT- 
6490  PRINT- 
6500  PRINT 
6510  PRINT 
6520  PRINT 
6530  PRINT 
6540  PRINT 
6550  INPUT- 
6560  CLS 
6570  PRINT 
6580  PRINT 
6590  PRINT 
6600  PRINT 
6610  PRINT 
6620  PRINT 
6630  PRINT 
6640  PRINT- 
6650  PRINT- 
6660  PRINT- 
6670  PRINT- 
6680  PRINT- 
6690  PRINT* 

6700  PRINT- 
6710  PRINT- 
6720  PRINT 
6730  PRINT 


Acceptance' 


In  genera],  governaent  acceptance  can  occur  before,* 
at  the  tiae  of,  or  even  after  delivery  of  the  product.' 
Inspecting  for  the  purpose  of  acceptance  is  a  critical* 
activity  for  the  governaent.  The  iaplications  of 
inspecting  for  acceptance  at  other  than  the  point  of  final* 
destination  could  terainate  the  contractor’s  liability- 
before  the  governaent  gets  final  assurance  of  the  fit  and' 
perforaance  of  the  product.  There  are  tuo  guidelines' 
which  establish  the  policy  for  governaent  acceptance.' 


To  continue,  press  <ENTER>*,P 


1.  Iaplied  acceptance  is  binding  on  the  governaent,* 
and  aost  frequently  occurs  as  a  result  of  the* 
governaent’s  use  or  retention  of  a  contractor's* 
product,  thereby  interfering  with  the  contractor's' 
ownership  of  that  product.  For  exaaple,  a  court- 
ruled  that  one  governaent  agency  gave  an  iaplied* 
acceptance  when  it  used  a  boiler  for  over  eighty- 
days  without  ever  foraally  accepting  that  itea. * 
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To  continue,  press  TENTER)1,? 


6740  PRINT 
6750  PRINT 
6760  PRINT 
6770  PRINT 
6780  PRINT 
6790  INPUT1 
6800  CIS 
6810  PRINT 
6820  PRINT 
6830  PRINT 
6840  PRINT 
6850  PRINT1 
6860  PRINT1 
6870  PRINT1 
6880  PRINT1 
6890  PRINT 
6900  PRINT1 
6910  PRINT 
6920  PRINT1 
6930  PRINT 
6940  PRINT1 
6950  PRINT 
6960  PRINT1 
6970  PRINT1 
6980  PRINT 
6990  PRINT 
7000  PRINT 
7010  PRINT 
7020  PRINT 
7030  INPUT* 

7040  COLOR  11,1 
7050  CLS 
7060  PRINT 
7070  COLOR  14,1 
7080  PRINT- 
7090  COLOR  11,1 
7100  PRINT 
7110  PRINT 
7120  PRINT1 
7130  PRINT 
7140  PRINT 
7150  PRINT1 
7160  PRINT1 
7170  PRINT1 
7180  PRINT 
7190  PRINT* 

7200  PRINT1 
7210  PRINT 


2.  The  FAR  provides  that  in  the  absence  of  at  least- 
one  of  four  ’ecognized  exceptions,  acceptance  is1 
conclusive.  The  four  exceptions  to  collusiveness1 
ares' 

a.  whenever  latent  defects  are  found,1 

b.  whenever  fraud  is  involved,1 

c.  whenever  gross  aistakes  aaount  to  fraud,  or* 

d.  whenever  warranties  are  included  in  the1 
contract.1 


To  continue,  press  TENTER)1, P 


SELF-TEST  BUESTION1 


Indicate  your  answer  to  the  following.1 


Interfering  with  the  contractor’s  ownership  of  its  product* 
can  be  seen  as  an  iaplied  acceptance  of  that  product1 
by  the  governaent.1 

a.  True* 

b.  False1 


7220  PRINT 

7230  WUT1  Select  a  or  b,  and  press  TENTER)  *,A0 
7240  IF  Af^A1  THEN  7320 
7250  IF  A«=V  THEN  7320 
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7260  IF  AI=*B* 
7270  IF  A4=*b* 
7280  PRINT 
7290  PRINT 
7300  PRINT* 
7310  GOTO  7220 
7320  PRINT 
7330  PRINT* 
7340  GOTO  7410 
7350  PRINT 
7360  PRINT* 
7370  PRINT* 
7380  PRINT* 

7390  PRINT* 
7400  PRINT’ 

7410  PRINT 
7420  INPUT* 

7430  COLOR  15,1 
7440  CIS 
7450  PRINT 
7460  PRINT 
7470  PRINT 
7480  PRINT 
7490  PRINT 
7500  PRINT 
7510  PRINT 
7520  PRINT 
7530  PRINT 
7540  PRINT* 

7550  PRINT* 

7560  PRINT* 

7570  PRINT 
7580  PRINT 
7590  PRINT 
7600  PRINT 
7610  PRINT 
7620  PRINT 
7630  PRINT 
7640  PRINT 
7650  PRINT 
7660  PRINT 
7670  INPUT* 

7680  CIS 
7690  PRINT 
7700  PRINT 
7710  PRINT 
7720  PRINT 
7730  PRINT* 

7740  PRINT* 

7750  PRINT* 

7760  PRINT* 

7770  PRINT* 


THEN  7350 
THEN  7350 


<*A**)  is  not  a  choice.  Try  again.* 


Correct.  Let's  continue.* 


Incorrect.  The  correct  answer  is  A.  Courts  of  law  have* 
ruled  that  government  interference  with  a* 
contractor’s  ownership  of  (ability  to  control)* 
a  product  can  constitute  an  iaplied  acceptance* 
of  that  product.* 

To  continue,  press  (ENTER)*, P 


Let’s  return  to  the  four  exceptions  to  conclusiveness,' 
latent  defects,  fraud,  gross  aistakes  which  aaount  to* 
fraud,  and  warranties,  and  consider  each  separately.' 


To  continue,  press  <ENTER)*,P 


A  latent  defect  is  one  which  is  hidden  froa  knowledge* 
and  sight,  and  could  not  be  found  through  reasonable* 
inspection  or  care.  A  aore  frequent  occurrence  is  a  patent* 
defect,  which  also  remains  hidden,  but  should  have  been* 
found  through  inspection  activities.  For  exaaple,  lack  of* 
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w* 


7780  PRINT* 
7790  PRIHT- 
7800  PRINT* 
7810  PRINT* 
7820  PRINT* 
7830  PRINT* 
7840  PRINT* 
7850  PRINT* 
7880  PRINT 
7870  PRINT 
7880  PRINT 
7890  PRINT 
7900  PRINT 
7910  INPUT* 

7920  as 

7930  PRINT 
7940  PRINT 
7950  PRINT 
7960  PRINT 
7970  PRINT 
7980  PRINT 
7990  PRINT* 
8000  PRINT* 
8010  PRINT* 
8020  PRINT* 
8030  PRINT* 
8040  PRINT* 
8050  PRINT* 
8060  PRINT* 
8070  PRINT* 
8080  PRINT 
8090  PRINT 
8100  PRINT 
8110  PRINT 
8120  PRINT 
8130  PRINT 
8140  PRINT 
8150  INPUT* 

8160  as 

8170  PRINT 
8180  PRINT 
8190  PRINT 
8200  PRINT 
8210  PRINT 
8220  PRINT 
8230  PRINT 
8240  PRINT* 
8250  PRINT* 
8260  PRINT* 
8270  PRINT* 
8280  PRINT* 
8290  PRINT* 


i  specified  hardness  for  a  grinding  wheel  was  not  found  to* 
be  latent  since  a  test  would  have  uncovered  the  deficiency.' 
On  the  other  hand,  a  case  where  16  of  alaost  12,000  bolts' 
were  found  to  be  undersized  was  ruled  as  latent  in  that  a* 
reasonable  saaple  inspection  would  not  likely  have* 
uncovered  those  defects.  At  any  rate,  the  burden  of  proof 
for  latency  rests  with  the  government,  and  experience  has* 
shown  this  to  be  a  substantial  burden  indeed.* 


To  continue,  press  <ENTER>*,P 


In  cases  of  fraud,  the  governaent  is  once  again  faced* 
with  substantial  burden  of  proof  that  its  acceptance  was* 
induced  by  a  deliberate  aisrepresentation  of  the  facts’ 
with  an  intent  to  aislead,  resulting  in  damages  to  the* 
governaent.  More  often  than  not,  when  the  governaent  has* 
evidence  to  support  allegations  of  fraud,  it  tends  to* 
prosecute  under  statutes  calling  for  civil  and  criainal* 
penalties  against  the  contractor.  If  successful,  the* 
governaent  receives  double  daaages.' 


To  continue,  press  (ENTER)*, P 


Gross  aistakes  also  result  in  overturning  governaent* 
acceptance.  Though  such  instances  have  the  appearance  of* 
fraud  and  produce  siailar  results,  the  key  distinction  is* 
that  gross  aistakes  are  not  intentional  acts.  An  exaaple* 
of  such  a  case  is  one  where  a  contractor  incorrectly* 
certified  that  particular  contract  items  were  identical  to* 
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8300  PRINT* 

8310  PRINT 
8320  PRINT 
8330  PRINT 
8340  PRINT 
8350  PRINT 
8380  PRINT 
8370  PRINT 
8380  PRINT 
8390  INPUT* 

8400  CIS 
8410  PRINT 
8420  PRINT 
8430  PRINT 
8440  PRINT 
8450  PRINT 
8460  PRINT 
8470  PRINT 
8480  PRINT* 

8490  PRINT* 

8500  PRINT* 

8510  PRINT* 

8520  PRINT* 

8530  PRINT* 

8540  PRINT* 

8550  PRINT- 
8560  PRINT 
8570  PRINT 
8580  PRINT 
8590  PRINT 
8600  PRINT 
8610  INPUT* 
8620  COLOR  11,1 
8630  CLS 
8640  PRINT 
8650  COLOR  14,1 
8660  PRINT* 

8670  COLOR  11,1 
8680  PRINT 
8690  PRINT 
8700  PRINT* 

8710  PRINT 
8720  PRINT 
8730  PRINT* 

8740  PRINT* 

8750  PRINT 
8760  PRINT 
8770  PRINT* 
8780  PRINT* 

8790  PRINT* 

8800  PRINT 
8810  PRINT 


ones  previously  tested  and  approved  by  the  governeent.* 


To  continue,  press  CENTER)*, P 


The  last  of  the  four  exceptions  to  governeent* 
acceptance  involves  warranties.  Warranties,  as  we  are* 
about  to  investigate  in  detail,  extend  the  contractor's* 
liability  for  its  product  past  the  tiee  of  acceptance  by* 
the  governeent.  The  governeent  pays  the  contractor  for* 
such  an  extension  as  specified  by  a  contract  and  therefore,' 
should  a  defect  arise  after  acceptance,  the  contractor* 
has  the  responsibility  to  correct  the  deficiency.* 


To  continue,  press  <ENTER>*,P 


SELF-TEST  BUESTI0N* 


Coaplete  the  following  stateeent.* 


The  burden  of  proof  for  latency,  fraud,  and  gross* 
■istakes:' 


a.  rests  on  the  contractor.* 

b.  rests  on  the  governeent.* 

c.  is  the  responsibility  of  a  civil  court  of  law.* 
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8820  INPUT’  Select  a,  b,  or  c,  and  press  <ENTER>  *,AI 

8830  IF  A4=*A*  THEN  8880 

8840  IF  At-’a’  THEN  8880 

B850  IF  A*=*B*  THEN  8830 

8880  IF  At=V  THEN  8830 

8870  IF  A*=*C*  THEN  8880 

8880  IF  Al=*c*  THEN  8860 

8880  PRINT 

8800  PRINT 

8810  PRINT’  (’AO*)  is  not  a  choice.  Try  again.' 

8820  60T0  8810 
8830  PRINT 

8840  PRINT’  Correct.  Let's  continue.' 

8850  GOTO  8000 
8860  PRINT 

8870  PRINT*  Incorrect.  The  correct  ansuer  is  B.  The  burden  of  proof* 

8880  PRINT*  in  any  of  these  three  instances  rests  with* 

8880  PRINT’  the  government.* 

8000  PRINT 

8010  INPUT*  To  continue,  press  <ENTER>*,P 

8020  COLOR  14,1 

8030  CLS 

8040  PRINT 

8050  PRINT 

8060  PRINT 

8070  PRINT 

9080  PRINT 

8090  PRINT 

9100  PRINT*  Narranties* 

9110  COLOR  15,1 
9120  PRINT 
9130  PRINT 

9140  PRINT*  The  FAR  defines  a  warranty  as  a  proeise  or  affiraation* 

9150  PRINT*  given  by  a  contractor  to  the  government  regarding  the* 

9160  PRINT*  nature,  usefulness,  or  conditions  of  the  supplies  or* 

9170  PRINT*  performance  of  services  furnished  under  a  contract.  There’ 

9180  PRINT*  are  two  types  of  warranties  which  are  applicable  to’ 

9190  PRINT*  government  contracting;  express  and  implied.  Let's  take' 

9200  PRINT*  a  look  at  each  of  these  separately.' 

9210  PRINT 
9220  PRINT 
9230  PRINT 
9240  PRINT 
9250  PRINT 
9260  PRINT 

9270  INPUT*  To  continue,  press  <ENTER>*,P 

9280  CLS 

9290  PRINT 

8300  PRINT 

9310  COLOR  14,1 

9320  PRINT*  Express  Warranties' 

9330  PRINT 
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9340  PRINT 
3350  COLOR  15, 1 
9360  PRINT* 

9370  PRINT* 
9380  PRINT* 

9390  PRINT* 
9400  PRINT- 
9410  PRINT* 
9420  PRINT* 

9430  PRINT* 

9440  PRINT* 

9450  PRINT* 

9460  PRINT* 
9470  PRINT 
9480  PRINT* 

9490  PRINT* 
9500  PRINT* 

9510  PRINT 
9520  PRINT 
9530  INPUT* 

9540  CLS 
9550  PRINT 
9560  PRINT 
9570  PRINT 
9580  PRINT 
9590  PRINT 
9600  PRINT 
9610  PRINT- 
9620  PRINT* 

9630  PRINT 
9640  PRINT- 
9650  PRINT- 
9660  PRINT 
9670  PRINT* 

9680  PRINT* 

9690  PRINT 
9700  PRINT- 
9710  PRINT- 
9720  PRINT 
9730  PRINT 
9740  PRINT 
9750  PRINT 
9760  PRINT 
9770  INPUT- 
9780  COLOR  11,1 
9790  CLS 
9800  PRINT 
9810  COLOR  14,1 
9820  PRINT’ 

9830  COLOR  11,1 
9840  PRINT 
9850  PRINT 


Express  warranties  are  ones  which  physically  appear  in* 
a  contractual  agreement.  Recent  changes  in  acquisition* 
policy  require  these  warranties  be  included  where  weapon* 
systea  production  costs  exceed  1100,000  per  itea  or* 

♦10  aillion  for  the  total  systea.  Though  it  aay  seea  that* 
the  governaent  aight  always  include  such  warranties  in  its* 
contracts,  the  governaent  tends  to  exercise  caution.  If* 
express  warranties  are  used,  their  duration  aust  be* 
clearly  spelled  out  in  the  contract.  The  FAR  sets  forth* 
five  factors  which  the  governaent  aust  consider  before* 
including  express  warranty  provisions  in  a  contract:* 

1.  The  nature  and  use  of  the  supplies  or  services  it* 
wishes  to  procure  (factors  such  as  coaplexity  and* 
the  potential  for  hidden  defects  apply  here),* 


To  continue,  press  (ENTER)*, P 


2.  The  dollar  costs  associated  with  the  contractor' 
agreeing  to  ext'  us  liability,* 

2.  Whether  the  governaent  has  the  resources  to* 
adainister  and  enforce  a  warranty,* 

4.  Whether  or  not  the  contracted  itea  is  noraally* 
warranted  in  the  trade,  and* 

5.  The  potential  for  reducing  governaent  inspection* 
in  light  of  a  warranty.* 


To  continue,  press  (ENTER)*, P 


SELF-TEST  8UESTI0N* 
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9860  PRINT*  Indicate  your  answer  to  the  following.' 

9870  PRINT 
9880  PRINT 

9890  PRINT*  The  decision  to  include  an  express  warranty  in  a  contract, ' 

9900  PRINT'  according  to  the  FAR,  need  not  include  consideration  of 

9910  PRINT’  the  government's  cost  of  enforcing  the  warranty.* 

9920  PRINT 

9930  PRINT'  a.  True' 

9940  PRINT*  b.  False' 

9950  PRINT 
9960  PRINT 

9970  INPUT'  Select  a  or  b,  and  press  < ENTER >  *,A$ 

9980  IF  A*=*A*  THEN  10090 
9990  IF  Ai='a*  THEN  10090 
10000  IF  Ats*8*  THEN  10060 
10010  IF  A$='b*  THEN  10060 
10020  PRINT 
10030  PRINT 

10040  PRINT'  (*A**>  is  not  a  choice.  Try  again.* 

10050  GOTO  9960 
10060  PRINT 

10070  PRINT*  Correct.  Let's  continue.* 

10080  SOTO  10140 
10090  PRINT 

10*00  PRINT'  Incorrect.  The  correct  answer  is  B.  Harranty  enforcement* 

10110  PRINT'  costs  are  among  many  factors  the  government* 

10120  PRINT'  must  consider  before  expressly  requiring  a* 

10130  PRINT'  warranty  in  a  contract.* 

10140  PRINT 

10150  INPUT"  To  continue,  pres*  CENTER)*, P 

10160  COLOR  14,1 

10170  as 

10180  PRINT 
10190  PRINT 
10200  PRINT 

10210  PRINT*  Implied  Narranties* 

10220  COLOR  15,1 
10230  PRINT 
10240  PRINT 

10250  PRINT*  Implied  warranties  do  not  physically  appear  in  the' 

10260  PRINT'  contract  but  are  recognized  by  lav  as  protection  to  the* 

10270  PRINT*  buyer  for  the  useful  nature  of  a  purchased  good.' 

10280  PRINT 

10290  PRINT'  To  illustrate,  consider  an  appliance  purchase  for  a* 

10300  PRINT*  television  or  toaster.  Host  warranties  which  accompany* 

10310  PRINT*  such  products  include  a  statement  indicating  the  purchaser* 

10320  PRINT*  may  have  additional  rights  depending  on  the  st^e  in  which’ 

10330  PRINT*  that  buyer  lives.  Such  statements  indicate  the  existence* 

10340  PRINT*  of  implied  warranties  to  protect  consumers.  These’ 

10350  PRINT*  warranties  may  even  extend  the  manufacturer's  liability* 

10360  PRINT*  past  the  period  explicitly  stated  in  the  warranty  clause* 

10370  PRINT*  itself.* 
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To  continue,  press  <ENTER>a,P 


10380  PRINT 
10390  PRINT 
10400  PRINT 
10410  INPUT* 
10420  CLS 
10430  PRINT 
10440  PRINT 
10450  PRINT 
10460  PRINT 
10470  PRINT 
10480  PRINT 
10490  PRINT 
10500  PRINT 
10510  PRINT* 
10520  PRINT* 
10530  PRINT* 
10540  PRINT* 
10550  PRINT* 
10560  PRINT* 
10570  PRINT 
10580  PRINT 
10590  PRINT 
10600  PRINT 
10610  PRINT 
10620  PRINT 
10630  PRINT 
10640  PRINT 
10650  INPUT* 
10660  CLS 
10670  PRINT 
10680  PRINT 
10690  PRINT 
10700  PRINT 
10710  PRINT 
10720  PRINT 
10730  PRINT* 
10740  PRINT* 
10750  PRINT 
10760  PRINT* 
10770  PRINT* 
107B0  PRINT* 
10790  PRINT* 
10800  PRINT* 
10810  PRINT* 
10820  PRINT 
10830  PRINT 
10840  PRINT 
10850  PRINT 
10860  PRINT 
10870  PRINT 
10880  PRINT 
10890  INPUT* 


Further,  under  governaent  contracts,  the  Unifora' 
Coaaercial  Code  (UCC)  states  iaplied  warranties  are* 
applicable  unless  specifically  excluded  by  language  written* 
into  the  contract.  On  nuaerous  occasions,  Boards  of* 
Contract  Appeals  have  relied  on  UCC  principles  of  iaplied* 
warranties  in  resolving  governaent  contract  disputes.* 


To  continue,  press  <ENTER>*,P 


There  are  two  types  of  iaplied  warranties  which* 
require  further  illustration.' 

The  first  type  of  iaplied  warranty,  aerchantability,' 
refers  to  the  requireaent  that  goods  are  appropriate  for* 
the  purpose  for  which  they  are  noraally  sold.  An  exaaple* 
aight  be  for  a  bucket's  iaplied  ability  to  hold  water.' 
Should  the  governaent  desire  to  waive  this  type  of 
warranty,  it  aay  do  so  either  orally  or  in  writing.* 


To  continue,  press  <ENTER>*,P 
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10900 

10910 

10920 

10930 

10940 

10950 

10960 

10970 

10980 

10990 

11000 

11010 

11020 

11030 

11040 

11050 

11060 

11070 

11080 

11090 

11100 

11110 

11120 

11130 

11140 

11150 

11160 

11170 

11180 

11190 

11200 

11210 

11220 

11230 

11240 

11250 

11260 

11270 

11280 

11290 

11300 

11310 

11320 

11330 

11340 

11350 

11360 

11370 

11380 

11390 

11400 

11410 


as 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

INPUT* 

COLOR  11,1 

CIS 

PRINT 

COLOR  14,1 

PRINT* 

COLOR  11,1 

PRINT 

PRINT 

PRINT* 

PRINT 

PRINT 

PRINT* 

PRINT 

PRINT 

PRINT* 

PRINT* 

PRINT- 

PRINT* 

PRINT 

PRINT 

INPUT* 

IF  ft$**A* 
IF  At=*a* 
IF  A$s*B* 
IF  At=*b* 
IF  AI**C* 
IF  Af=*c* 
PRINT 


The  second  type,  fitness  for  a  particular  purpose,  can* 
only  be  vaived  in  writing.  Warranties  for  fitness  suggest* 
a  buyer  who  is  relying  on  the  judgment  of  the  seller  to* 
select  suitable  goods.  That  is,  goods  will  in  fact  be  fit* 
for  the  buyer’s  purpose.  For  exaaple,  a  salesman  eight* 
tell  a  c ustcuer  that  a  particular  solvent  will  reeove  oil* 
stains  on  a  driveway.  Should  the  solvent,  which  is* 
noreally  used  for  other  applications,  not  perfora  as  the* 
salesaan  proaised,  the  custoeer  has  grounds  for  getting* 
his  or  her  aoney  back  froa  the  sale.* 


To  continue,  press  CENTER)*, P 


SELF-TEST  BUESTION* 


Coaplete  the  following  stateae.it.* 

According  to  the  UCC,  iaplied  warranties  are  applicable:* 


a.  unless  waived  by  the  contracting  officer.* 

b.  unless  a  Certificate  of  Conforaance  is  subaitted* 
by  the  contractor.* 

c.  unless  excluded  by  written  notice  in  the  contract.' 


Select  a,  b,  or  c,  and  press  CENTER)  *,A$ 
THEN  1 1480 
THEN  11480 
THEN  11480 
THEN  11480 
THEN  11450 
THEN  11450 


75 


11420  PRINT 
11430  PRINT* 
11440  GOTO  11330 
11450  PRINT 
11460  PRINT* 
11470  GOTO  11520 
11480  PRINT 
11490  PRINT* 
11500  PRINT* 
11510  PRINT* 
11520  PRINT 
11530  INPUT* 
11540  COLOR  14,1 
11550  CLS 
11560  PRINT 
11570  PRINT* 
11580  COLOR  15,1 
11590  PRINT 
11600  PRINT 
11610  PRINT* 
11620  PRINT* 
11630  PRINT* 
11640  PRINT* 
11650  PRINT* 
11660  PRINT 
11670  PRINT* 
11680  PRINT* 
11690  PRINT 
11700  PRINT* 
11710  PRINT* 
11720  PRINT- 
11730  PRINT 
11740  PRINT* 
11750  PRINT* 
11760  PRINT* 
11770  PRINT 
11780  PRINT 
11790  INPUT* 
11800  CLS 
11810  PRINT 
11820  PRINT 
11830  PRINT 
11840  COLOR  >4,1 
11850  PRINT* 
11860  PRINT 
11870  COLOR  15,1 
11880  PRINT* 
11890  PRINT* 
11900  PRINT* 
11910  PRINT* 
11920  PRINT* 
11930  PRINT* 


(*A$‘>  is  not  a  choice.  Try  again.* 


Correct.  Let’s  continue.' 


Incorrect.  The  correct  ansver  is  C.  Ieplied  warranties' 
are  applicable  unless  specifically  excluded* 
in  the  written  contract.* 

To  continue,  press  <ENTER>*,P 


Warranty  Breaches* 


Options  available  to  an  individual  who  is  the  victis  of* 
a  warranty  breach  (default)  are  somewhat  siailar  to  those* 
the  government  night  take  against  a  contractor.  Should  a* 
breach  occur,  the  government  contracting  officer  has* 
two  options:' 

1.  the  contractor  nay  be  required  to  correct  or* 
replace  nonconforming  supplies  (or  parts),  or* 

2.  the  government  may  retain  the  nonconfornables  and* 
require  the  contractor  to  make  an  equitable* 
adjustment  in  price.* 

In  either  case,  the  FAR  stipulates  that  the* 
contractor's  obligation  to  repair,  replace,  or  adjust* 
price  will  include  appropriate  labor  and  material  costs.* 


To  continue,  press  (ENTER)*, P 


Concluding  Remarks* 


Given  the  conclusiveness  of  acceptance  and  the* 
difficulties  the  government  can  have  in  proving  claims* 
against  a  contractor,  it  is  easy  to  see  why  the  government' 
places  such  high  priority  on  inspection  programs.  Further,' 
the  government’s  reliance  on  inspections  as  the  primary* 
means  of  ensuring  product  quality  has  minimized  the  role* 
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11940  PRINT*  of  warranties  for  many  acquisitions.  However,  when  system* 
11950  PRINT*  complexity  or  other  factors  suggest  appreciable  risk,  the* 

11960  PRINT*  government  turns  to  warranties  for  continued  assurance  of 

11970  PRINT*  product  quality  after  acceptance.  These  two  critical* 

11980  PRINT*  mechanisms,  inspection  and  warranty,  are  the  government's* 

11990  PRINT*  tools  for  ensuring  it  receives  what  it  bargains  tor  when* 

12000  PRINT*  it  makes  purchases  under  contractual  agreements.* 

12010  PRINT 
12020  PRINT 
12030  PRINT 
12040  PRINT 

12050  INPUT*  To  continue,  press  <ENtER>*,P 

12060  COLOR  11,1 

12070  as 

12080  PRINT 
12090  COLOR  14,1 

12100  PRINT*  SELF-TEST  QUESTION* 

12110  COLOR  11,1 
12120  PRINT 
12130  PRINT 

12140  PRINT*  Indicate  your  answer  to  the  following.* 

12150  PRINT 
12160  PRINT 

12170  PRINT*  If  a  product  has  a  defect  and  the  contractor  breaches  the* 

12180  PRINT*  warranty  agreement  covering  the  product,  the  government  may* 

12190  PRINT*  require  the  contractor  to  adjust  the  product's  price.* 

12200  PRINT 
12210  PRINT 

12220  PRINT*  a.  True* 

12230  PRINT*  b.  False* 

12240  PRINT 
12250  PRINT 

12260  INPUT'  Select  a  or  b,  and  press  <ENTER>  *,A* 

12270  IF  Af=*A*  THEN  12350 
12280  IF  A$=*a*  THEN  12350 
12290  IF  A$=*8*  THEN  12380 
12300  IF  A$=*b*  THEN  12380 
12310  PRINT 
12320  PRINT 

12330  PRINT*  (*A!*)  is  not  a  choice.  Try  again.' 

12340  GOTO  12250 
12350  PRINT 

12360  PRINT*  Correct.  Let's  continue.' 

12370  60T0  12430 
12380  PRINT 

12390  PRINT*  Incorrect.  The  correct  answer  is  A.  The  government  may* 
12400  PRINT*  require  a  contractor  to  make  an  equitable* 

12410  PRINT*  adjustment  in  price  should  the  contractor* 

12420  PRINT*  breach  a  warranty.' 

12430  PRINT 

12440  INPUT*  To  continue,  press  <ENTER>*,P 

12450  CLS 
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END  or  LESSON' 


12460  COLOR  14,1 
12470  PRINT 
12480  PRINT* 

12490  PRINT 
12500  PRINT 
12510  COLOR  15,1 

12520  PRINT*  You  have  completed  the  computerized  text  portion  of* 

12530  PRINT*  this  exercise.  Before  proceeding  to  the  quiz,  please  do* 
12540  PRINT*  the  following! * 

12550  PRINT 

12560  PRINT*  1.  Open  the  quiz  envelope  and  remove  the  quiz.* 

12570  PRINT 

125B0  PRINT*  2.  Nrite  the  elapsed  time  shown  on  the  blackboard  on* 

12590  PRINT*  the  cover  of  your  quiz.* 

12600  PRINT 

12610  PRINT*  3.  On  the  computer  keyboard,  type  the  word  SYSTEH* 

12620  PRINT*  and  press  the  <£NTER>  key.* 

12630  PRINT 

12640  PRINT*  4.  Turn  off  your  monitor  by  depressing  the  ON/OFF* 

12650  PRINT*  button  at  the  front  of  your  color  monitor.* 

12660  PRINT 

12670  PRINT*  5.  Open  the  quiz  and  answer  the  questions.* 

12680  PRINT 
12690  PRINT 
12700  END 
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Append i x  Bi  Bottom-up  Structured  Lesson 


10  REN  THIS  I 
20  KEY  OFF 
30  COLOR  14,1 
40  CLS 
50  PRINT 
60  PRINT’ 

70  PRINT 
80  PRINT 
90  COLOR  15,1 
100  PRINT’ 

110  PRINT’ 

120  PRINT* 

130  PRINT’ 

140  PRINT* 

150  PRINT* 

160  PRINT’ 

170  PRINT’ 

180  PRINT 
190  PRINT* 

200  PRINT’ 

210  PRINT 
220  PRINT’ 

230  PRINT’ 

240  PRINT 
250  PRINT’ 

260  PRINT’ 

270  PRINT 
280  INPUT’ 

290  as 

300  PRINT 
310  PRINT 
320  PRINT 
330  PRINT 
340  PRINT’ 

350  PRINT’ 

360  PRINT’ 

370  PRINT’ 

380  PRINT’ 

390  PRINT’ 

400  PRINT’ 

410  PRINT 
420  PRINT* 

430  PRINT’ 

440  PRINT* 

450  PRINT’ 

460  PRINT 
470  PRINT’ 

480  PRINT* 

490  PRINT 


THE  80TT0H-UP  STRUCTURED  PROGRAM 


INTRODUCTION* 


Ueicote  to  this  presentation  on  governaent  contracting.' 

The  aaterial  you  are  about  to  review  is  based  on  subject* 
aatter  extracted  fro*  the  Federal  Acquisition  Regulation* 
(FAR)  and  AFIT  course  CH6T  523,  Contracting  and  Acquisition' 
Hanageaent.  This  aaterial  vas  chosen  not  only  for  its* 
interest  to  AF  aanagers  but  for  its  relevance  to  your* 
career  field  in  particular.  There  are  three  parts  to* 
this  presentation:* 

1.  The  text  portion  using  coaputer-assisted* 
instruction  (following  these  introductions),' 

2.  A  written  quiz  (in  the  envelope  beside  your* 
coaputer)  over  the  learning  aaterial  in  step  1,' 

3.  A  brief  survey,  following  the  written  quiz,  to* 
ask  for  your  feedback  on  this  presentation.' 

To  continue,  press  <ENTER>’,P 


The  coaputer  prograa  itself  is  written  like  a  text,  but* 
with  a  SELF-TEST  SUESTI0N  occasionally  inserted  to  help* 
you  reinforce  aain  points.  These  questions,  displayed* 
with  the  saae  blue  background  you  see  here  but  with  light* 
blue  text  writing,  will  also  give  you  a  good  idea  of  what' 
to  expect  froa  the  short  quiz  you  will  coaplete  at  the* 
conclusion  of  this  coaputer  portion  of  the  exercise.' 

Your  participation  in  this  review  is  greatly  appreciated.* 
Though  your  progress  through  the  text  portion  will  be* 
tiaed,  please  work  at  a  pace  which  is  coafortable  to  you.' 
This  is  not  a  coapetition  to  see  who  finishes  first.' 

THANK  YOU  in  advance  for  your  efforts  and  feedback  during* 
this  exercise.* 
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500  PRINT 
510  PRINT 
520  PRINT 
530  INPUT1 
540  C010R  15,1 
550  CLS 
560  COLOR  14,1 
570  PRINT 
580  PRINT 
590  PRINT 
600  PRINT 
610  PRINT 
620  PRINT* 

630  COLOR  15,1 
640  PRINT 
650  PRINT 
660  PRINT1 
670  PRINT* 

680  PRINT- 
690  PRINT* 

700  PRINT" 

710  PRINT* 

720  PRINT* 

730  PRINT* 

740  PRINT* 

750  PRINT 
760  PRINT 
770  PRINT 
780  PRINT 
790  PRINT 
BOO  INPUT* 

810  CLS 
820  PRINT 
830  PRINT 
840  PRINT 
850  PRINT 
860  PRINT 
870  PRINT 
880  PRINT* 

890  PRINT* 

900  PRINT* 

910  PRINT* 

920  PRINT* 

930  PRINT* 

940  PRINT* 

950  PRINT* 

960  PRINT* 

970  PRINT* 

980  PRINT 
990  PRINT 
1000  PRINT 
1010  PRINT 


To  continue,  press  <ENTER>*,P 


Purchasing  Goods  and  Services* 


Buying  products  and  services  is  a  part  of  everyday* 
life.  Ho*t  purchases  are  planned,  especially  when  the* 
cost  of  the  goods  or  services  is  an  appreciable  part  of  an* 
individual's  incoee.  Further,  eost  people  seek  to  aaxieize* 
their  purchasing  power  by  getting  the  eost  for  their* 
dollar.  As  a  result,  huean  nature  leads  consumers  to* 
deaand  that  a  aanufacturer  provide  soae  assurance  that  its* 
products  will  function  as  advertised  for  a  specified  aaount* 
of  tiae.  Product  warranties  provide  such  assurances.* 


To  continue,  press  (ENTER)', P 


Since  aost  consuaers  are  not  able  to  witness  the* 
aanufacturing  process,  the  assurance  of  quality  through* 
product  warranties  can  deteraine  whether  or  not  a  product* 
is  selected  by  the  consuaer.  Warranties  are  the  consuaer's* 
avenue  for  recourse  should  the  purchased  good  not  perfora* 
as  proaised.  Producers  who  do  not  warrant  their  products* 
can  find  theeselves  losing  an  appreciable  portion  of  their* 
aarket  as  a  result.  However,  such  reliance  on  warranties' 
is  not  necessarily  the  case  when  the  governaent  aakes* 
purchases  through  contracts.' 
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1020  PRINT 
1030  PRINT 
1040  INPUT1 

ioso  as 

1060  PRINT 
1070  PRINT 
1080  PRINT 
1090  PRINT 
1100  PRINT 
1110  COLOR  14,1 
1120  PRINT* 

1130  PRINT 
1140  PRINT 
1150  COLOR  15,1 
1160  PRINT* 

1170  PRINT* 

1180  PRINT* 

1190  PRINT* 

1200  PRINT* 

1210  PRINT* 

1220  PRINT* 

1230  PRINT* 

1240  PRINT* 

1250  PRINT- 
1260  PRINT 
1270  PRINT 
1280  PRINT 
1290  PRINT 
1300  INPUT* 

1310  CLS 
1320  PRINT 
1330  PRINT 
1340  COLOR  14,1 
1350  PRINT- 
1360  COLOR  15,1 
1370  PRINT 
1380  PRINT 
1390  PRINT* 

1400  PRINT- 
1410  PRINT* 

1420  PRINT* 

1430  PRINT* 

1440  PRINT 
1450  PRINT- 
1460  PRINT* 

1470  PRINT* 

1480  PRINT* 

1490  PRINT- 
1500  PRINT- 
1510  PRINT 
1520  PRINT- 
1530  PRINT* 


To  continue,  press  <ENTER)*,P 


Warranties* 


Much  as  ve  consider  the  warranty  to  be  a  aanufacturer's* 
assurance  of  quality,  the  Federal  Acquisition  Regulation* 
(FAR)  defines  a  warranty  as  a  proaise  or  affiraation  given* 
by  a  contractor  to  the  governaent  regarding  the  nature,* 
usefulness,  or  conditions  of  the  supplies  or  perforaance  of 
services  furnished  under  the  contract.  Written  warranties' 
on  such  things  as  appliances  and  cars  provide  the  everyday* 
consuaer  soae  degree  of  confidence  in  a  purchase.  Such  a* 
warranty  which  physically  appears  in  a  contract  is  called* 
an  express  warranty.* 


To  continue,  press  (ENTER)', P 


Express  Warranties' 


Recent  changes  in  acquisition  policy  require  that* 
express  warranties,  whose  durations  aust  be  clearly* 
spelled  out  in  the  contract,  be  included  where  weapon* 
systea  production  costs  exceed  1100,000  per  itea  or* 

110  aillion  for  the  total  systea.' 

Though  it  aight  seea  that  the  governaent  would  always* 
include  express  warranties  in  a  contract,  in  reality  the* 
governaent  exercises  caution  before  doing  so.  The  FAR* 
sets  forth  five  factors  which  the  governaent  aust* 
consider  before  including  express  warranty  provisions' 
in  a  contract.' 

1.  The  nature  and  use  of  the  supplies  or  services  if 
wishes  to  procure  (factors  such  as  coaplexity  and* 
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1S40 

1550 

1560 

1570 

1580 

1590 

1600 

1610 

1620 

1630 

1640 

1650 

1660 

1670 

1680 

1690 

1700 

1710 

1720 

1730 

1740 

1750 

1760 

1770 

1780 

1790 

1800 

1810 

1820 

1830 

1840 

1850 

I860 

1870 

1880 

1890 

1900 

1910 

1920 

1930 

1940 

1950 

1960 

1970 

1980 

1990 

2000 

2010 

2020 

2030 

2040 

2050 


PRINT* 

PRINT 

INPUT* 

CIS 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

INPUT* 

CIS 

COLOR  11,1 

CIS 

PRINT 

COLOR  14,1 

PRINT* 

COLOR  11,1 

PRINT 

PRINT 

PRINT* 

PRINT 

PRINT 

PRINT- 

PRINT* 

PRINT* 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT 

INPUT* 


the  potential  for  hidden  defects  apply  here),' 

To  continue,  press  <ENTER>*,P 


2.  The  dollar  costs  associated  with  the  contractor* 
agreeing  to  extend  its  liability,' 

3.  Whether  or  not  the  government  has  the  resources* 
to  administer  and  enforce  a  warranty,* 

4.  Whether  or  not  the  contracted  item  is  normally* 
warranted  in  the  trade,  and* 

5.  The  potential  for  reducing  government  inspection* 
in  light  of  a  warranty.* 


To  continue,  press  CENTER)*, P 


SELF-TEST  QUESTION* 


Indicate  your  answer  to  the  following.* 


The  decision  to  include  express  warranties  in  a  contract,* 
according  to  the  FAR,  need  not  include  consideration  of* 
the  cost  of  enforcing  the  warranty.* 

a.  True* 

b.  False* 


Select  a  or  b,  and  press  CENTER)  *,At 


IF  AI=*A*  THEN  2130 
IF  A$=*a*  THEN  2130 
IF  A*=*B*  THEN  2100 
IF  A$=*b*  THEN  2100 
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2060  PRINT 
2070  PRINT 
2080  PRINT' 

2090  GOTO  2000 
2100  PRINT 
2110  PRINT' 

2120  GOTO  2180 
2130  PRINT 
2140  PRINT* 

2150  PRINT* 

2160  PRINT' 

2170  PRINT' 

2180  PRINT 
2190  INPUT' 

2200  COLOR  14,1 
2210  CIS 
2220  PRINT 
2230  PRINT 
2240  PRINT 
2250  PRINT' 

2260  COLOR  15,1 
2270  PRINT 
2280  PRINT 
2290  PRINT* 

2300  PRINT' 

2310  PRINT' 

2320  PRINT 
2330  PRINT' 

2340  PRINT' 

2350  PRINT* 

2360  PRINT- 
2370  PRINT* 

2380  PRINT' 
2390  PRINT* 

2400  PRINT' 

2410  PRINT 
2420  PRINT 
2430  PRINT 
2440  PRINT 
2450  INPUT* 

2460  as 

2470  PRINT 
2480  PRINT 
2490  PRINT 
2500  PRINT 
2510  PRINT 
2520  PRINT 
2530  PRINT* 

2540  PRINT' 

2550  PRINT' 

2560  PRINT* 

2570  PRINT* 


CA$*1  is  not  a  choice.  Try  again.' 


Correct.  Let's  continue.' 


Incorrect.  The  correct  answer  is  B.  Warranty  enforcement* 
costs  are  among  aany  factors  the  government* 
must  consider  before  expressly  requiring  a* 
warranty  in  a  contract.' 

To  continue,  press  (ENTER)*, P 


Implied  Warranties' 


Implies  warranties  do  not  physically  appear  in  the* 
contract  but  are  recognized  by  law  as  protection  to  the* 
buyer  for  the  useful  nature  of  a  purchased  good.* 

To  illustrate,  consider  an  appliance  purchase  for  a* 
television  or  toaster.  Host  warranties  which  accompany* 
such  products  include  a  statement  indicating  the  purchaser* 
may  have  additional  rights  depending  on  the  state  in  which* 
that  buyer  lives.  Such  statements  indicate  the  existence* 
of  implied  warranties  to  protect  consumers.  These* 
warranties  may  even  extend  the  manufacturer’s  liability* 
past  the  period  stated  by  an  express  warranty.' 


To  continue,  press  (ENTER)’, P 


Further,  under  government  contracts,  the  Uniform* 
Commercial  Code  (UCC)  states  implied  warranties  areJ 
applicable  unless  specifically  excluded  by  language  written* 
into  the  contract.  On  numerous  occasions,  Boards  of 
Contract  Appeals  have  relied  on  UCC  principles  of  implied* 
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2580  PRINT* 
2590  PRINT 
2600  PRINT* 
2610  PRINT* 
2620  PRINT 
2630  PRINT 
2640  PRINT 
2650  PRINT 
2660  PRINT 
2670  PRINT 
2680  PRINT 
2690  INPUT* 
2700  CLS 
2710  PRINT 
2720  PRINT 
2730  PRINT 
2740  PRINT 
2750  PRINT 
2760  PRINT 
2770  PRINT 
2780  PRINT- 
2790  PRINT* 
2800  PRINT- 
2810  PRINT- 
2820  PRINT- 
2830  PRINT 
2840  PRINT- 
2850  PRINT* 
2860  PRINT* 
2870  PRINT 
28B0  PRINT 
2890  PRINT 
2900  PRINT 
2910  PRINT 
2920  PRINT 
2930  INPUT- 
2940  CLS 
2950  PRINT 
2960  PRINT 
2970  PRINT 
2980  PRINT 
2990  PRINT 
3000  PRINT 
3010  PRINT 
3020  PRINT 
3030  PRINT* 
3040  PRINT* 
3050  PRINT’ 
3060  PRINT* 
3070  PRINT* 
3080  PRINT* 
3090  PRINT* 


warranties  in  resolving  government  contract  disputes.* 

There  are  two  types  of  iaplied  warranties  which* 
require  further  illustration.' 


To  continue,  press  <ENTER)',P 


When  purchasing  an  itea  for  its  generally  advertised* 
purpose,  like  a  haaaer  for  driving  in  nails,  an  iaplied* 
warranty  of  aerchantability  is  in  effect.  Such  a  warranty* 
requires  that  goods  are  appropriate  for  the  purpose  for* 
which  they  are  noraally  sold.* 

If  the  governaent  wants  to  waive  an  iaplied  warranty* 
of  aerchantability  in  its  contracts,  it  can  do  so  either* 
orally  or  in  writing.* 


To  continue,  press  <ENTER>',P 


Now  suppose  the  salesperson  who  sells  hammers  tells* 
buyers,  when  asked,  that  the  haaaer  is  also  ideal  for* 
scraping  ice  off  windshields  during  winter  months.  Here* 
an  iaplied  warranty  called  fitness  for  a  particular  purpose* 
is  in  effect.  Such  a  warranty  relies  on  the  judgement  of* 
the  seller  to  select  suitable  goods.  Warranties  for* 
fitness  can  only  be  waived  in  writing.' 
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To  continue,  press  <ENTER>*,P 


3100  PRINT 
3110  PRINT 
3120  PRINT 
3130  PRINT 
3140  PRINT 
3150  PRINT 
3160  PRINT 
3170  INPUT* 

3180  COLOR  11,1 
3190  CLS 
3200  PRINT 
3210  COLOR  14,1 
3220  PRINT*  SELT-TEST  QUESTION* 

3230  COLOR  11,1 
3240  PRINT 
3250  PRINT 

3260  PRINT*  Complete  the  fol loving  statement.’ 

3270  PRINT 
3230  PRINT 

3290  PRINT*  According  to  the  UCC,  itplied  warranties  are  applicable:' 

3300  PRINT 
3310  PRINT 

3320  PRINT*  a.  unless  uaived  by  the  contracting  officer.* 

3330  PRINT*  b.  unless  a  Certificate  of  Conforiance  is  submitted* 

3340  PRINT*  by  the  contractor.* 

3350  PRINT*  c.  unless  excluded  by  written  notice  in  the  contract.* 

3360  PRINT 
3370  PRINT 

3380  INPUT*  Select  a,  b,  or  c,  and  press  <ENTER>  V* 

3390  IT  A*=*A*  THEN  3520 
3400  IF  A4=*a*  THEN  3520 
3410  IF  A4=*B*  THEN  3520 
3420  IF  Al=*b*  THEN  3520 
3430  IF  AI='C*  THEN  3490 
3440  IF  A$=*c*  THEN  3490 
3450  PRINT 
3460  PRINT 

3470  PRINT*  < *A$* )  is  not  a  choice.  Try  again.* 

3480  60T0  3370 
3490  PRINT 

3500  PRINT*  Correct.  Let’s  continue.* 

3510  GOTO  3560 
3520  PRINT 

3530  PRINT*  Incorrect.  The  correct  answer  is  C.  Iaplied  warranties* 

3540  PRINT*  are  applicable  unless  specifically  excluded* 

3550  PRINT*  in  the  written  contract.* 

3560  PRINT 

3570  INPUT*  To  continue,  press  <ENTER>*,P 

3580  COLOR  14,1 
3590  CLS 
3600  PRINT 

3610  PRINT*  Narranty  Breaches* 
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3620  COLOR  15,1 
3630  PRINT 
3640  PRINT 

3650  PRINT*  Options  available  to  an  individual  vho  is  the  victii  of* 

3660  PRINT*  a  warranty  breach  (default)  are  soaewhat  siailar  to  those* 

3670  PRINT*  the  governaent  aight  take  against  a  contractor.  Should  a* 

3680  PRINT*  breach  (default)  occur,  the  governaent  contracting  officer* 

3690  PRINT*  has  two  options.* 

3700  PRINT 

3710  PRINT*  1.  the  contractor  aay  be  required  to  correct  or* 

3720  PRINT*  replace  nonconforaing  supplies  (or  parts),  or* 

3730  PRINT 

3740  PRINT*  2.  the  governaent  aay  retain  the  none on for Babies  and* 

3750  PRINT*  require  the  contractor  to  aake  an  equitable* 

3760  PRINT*  adjustaent  in  price.' 

3770  PRINT 

3780  PRINT*  In  either  case,  the  FAR  stipulates  that  the* 

3790  PRINT*  contractor's  obligation  to  repair,  replace,  or  adjust* 

3800  PRINT*  price  will  include  appropriate  labor  and  aaterial  costs.* 

3810  PRINT 
3820  PRINT 

3830  INPUT*  To  continue,  press  <ENTER>*,P 

3840  COLOR  11,1 

3850  CLS 

3860  PRINT 

3870  COLOR  14, 1 

3880  PRINT*  SELF-TEST  QUESTION* 

3890  COLOR  11,1 
3900  PRINT 
3910  PRINT 

3920  PRINT*  Indicate  your  answer  to  the  following.* 

3930  PRINT 
3940  PRINT 

3950  PRINT*  If  a  product  has  a  defect  and  the  contractor  breaches  the* 

3960  PRINT’  warranty  agreeaent  covering  the  product,  the  governaent  aay* 

3970  PRINT*  require  the  contractor  to  adjust  the  product's  price.* 

3980  PRINT 

3990  PRINT*  a.  True* 

4000  PRINT*  b.  False* 

4010  PRINT 
4020  PRINT 

4030  INPUT*  Select  a  or  b,  and  press  (ENTER)  *,A» 

4040  IF  At=*A*  THEN  4120 
4050  IF  A$=*a*  THEN  4120 
4060  IF  Al=*8*  THEN  4150 
4070  IF  At=*b*  THEN  4150 
4080  PRINT 
4090  PRINT 

4100  PRINT*  (*A$*)  is  not  a  choice.  Try  again.* 

4110  SOTO  4020 
4120  PRINT 

4130  PRINT*  Correct.  Let's  continue.* 
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4140  GOTO  4200 
4150  PRINT 
4160  PRINT' 

4170  PRINT* 
4180  PRINT' 

4190  PRINT' 
4200  PRINT 
4210  INPUT* 

4220  COLOR  15, 1 
4230  CLS 
4240  PRINT 
4250  PRINT 
4260  PRINT 
4270  PRINT 
4280  PRINT 
4290  PRINT' 

4300  PRINT' 

4310  PRINT' 

4320  PRINT' 
4330  PRINT' 

4340  PRINT' 

4350  PRINT' 

4360  PRINT' 
4370  PRINT' 

4380  PRINT- 
4390  PRINT' 

4400  PRINT- 
4410  PRINT 
4420  PRINT 
4430  PRINT 
4440  PRINT 
4450  PRINT 
4460  INPUT- 
4470  CLS 
4480  PRINT 
4490  PRINT 
4500  COLOR  14,1 
4510  PRINT- 
4520  PRINT 
4530  COLOR  15,1 
4540  PRINT* 

4550  PRINT' 

4560  PRINT* 
4570  PRINT* 
4580  PRINT* 

4590  PRINT- 
4600  PRINT- 
4610  PRINT' 

4620  PRINT* 

4630  PRINT- 
4640  PRINT- 
4650  PRINT* 


Incorrect.  The  correct  answer  is  A.  The  government  say* 
require  a  contractor  to  take  an  equiUole' 
adjustment  in  price  should  the  contractor* 
breach  a  warranty.* 


To  continue,  press  <ENTER>',P 


The  preceding  discussion  highlights  the  implications* 
of  both  express  and  implied  warranties.  However,  as  noted* 
earlier,  the  emphasis  on  warranties  is  greater  for  the* 
individual  than  for  the  government  because  the  latter  has' 
an  insight  into  the  development  of  a  product  that  we,  as* 
individual  buyers,  do  not  obtain.  As  a  result,  though' 
important  for  many  government  programs  and  even  mandated* 
under  certain  conditions,  warranties  are  considered  the' 
government’s  second  line  of  defense  when  it  makes  a* 
purchase  under  a  contract.  The  government's  active* 
involvement  in  the  development  process  is  its  primary  means' 
of  ensuring  quality  from  a  contractor.* 


To  continue,  press  <ENTER>',P 


Inspection* 


6iven  the  opportunity,  an  individual  will  investigate* 
the  functionality  and  esthetics  <if  applicable)  of  a* 
product  before  purchasing.  Test  drives  and  expert* 
(mechanic)  opinion,  for  example,  are  ways  to  ensure  we* 
make  intelligent  car  buying  decisions.  Often,  however,1 
an  individual’s  ability  to  really  inspect  an  item  is* 
limited  such  that  he  or  she  ends  up  relying  more  on* 
warranties  for  protection  should  something  go  wrong  with* 
the  purchase.  This  is  contrary  to  how  the  government* 
operates;  it  uses  inspection  as  its  primary  means  of 
ensuring  quality.  The  amount  of  government  inspection* 
depends  on  two  things: ' 
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4660 

4670 

4680 

4690 

4700 

4710 

4720 

4730 

4740 

4750 

4760 

4770 

4780 

4790 

4800 

4810 

4820 

4830 

4840 

4850 

4860 

4870 

4880 

4890 

4900 

4910 

4920 

4930 

4940 

4950 

4960 

4970 

49B0 

4990 

5000 

5010 

5020 

5030 

5040 

5050 

5060 

5070 

5080 

5090 

5100 

5110 

5120 

5130 

5140 

5150 

5160 

5170 


PRINT 

PRINT- 

PRINT 

PRINT* 

PRINT 

PRINT 

INPUT* 

CIS 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT- 

PRINT' 

PRINT- 

PRINT* 

PRINT- 

PRINT- 

PRINT- 

PRINT- 

PRINT 

PRINT- 

PRINT- 

PRINT- 

PRINT 

PRINT- 

PRINT- 

PRINT 

PRINT 

PRINT 

INPUT- 

COLOR  11,1 

CLS 

PRINT 

COLOR  14,1 

PRINT- 

COLOR  11,1 

PRINT 

PRINT 

PRINT- 

PRINT 

PRINT 

PRINT- 

PRINT* 

PRINT 

PRINT- 

PRINT* 

PRINT 

PRINT 

INPUT- 


1.  the  contractor  involved  in  the  procurement,  and* 

2.  the  nature  of  the  purchase  (complexities,  etc.).' 


To  continue,  press  (ENTER)*, P 


Whether  an  individual  buying  a  product,  or  the* 
government  acting  in  a  proprietary  manner  on  a  system- 
acquisition,  the  contractor  is  held  responsible  for- 
operating  and  maintaining  adequate  inspection  programs.’ 

The  PAR  specifies  that  the  government  shall  rely  on  the* 
contractor  to  perform  all  necessary  inspections  and  tests.* 
The  exceptions  to  this  rule,  as  deemed  necessary  by  the* 
contracting  officer,  can  occur  at  either  of  the  following;' 

1.  any  time  when  the  government  has  a  need  to  perform* 
such  activities  to  check  the  contractor's  internal* 
work  processes,  and* 

2.  in  advance  of  accepting  the  contractor's  offer  of 
the  final  product.' 


To  continue,  press  (ENTER>*,P 


SELF-TEST  BUESTION* 


Before  continuing,  indicate  your  answer  to  the  following.* 


Without  exception,  the  FAR  requires  a  contractor  to  perform* 
all  necessary  inspection  activities.* 

a.  True* 

b.  False- 


Select  a  or  b,  and  press  (ENTER)  *,AI 


IF  Afs*A*  THEN  5270 
IF  A$=*a*  THEN  5270 
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S180 

5190 

5200 

5210 

5220 

5230 

5240 

5250 

5260 

5270 

5280 

5281 

5282 

5283 
5310 
5320 
5330 
5340 
5350 
5360 
5370 
5380 
5390 
5400 
5410 
5420 
5430 
5440 
5450 
5460 
5470 
5480 
5490 
5500 
5510 
5520 
5530 
5540 
5550 
5560 
5570 
5580 
5590 
5600 
5610 
5620 
5630 
5640 
5650 
5660 
5670 
5680 


If  Al='8'  THEN  5240 
IF  A»='b‘  THEN  5240 


PRINT 

PRINT 

PRINT' 

60T0  5140 

PRINT 

PRINT' 

SOTO  5310 

PRINT 

PRINT' 

PRINT' 

PRINT' 

PRINT' 

PRINT 

INPUT* 

COLOR  15,1 

CLS 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT' 

PRINT- 

PRINT' 

PRINT* 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

INPUT* 

as 

PRINT 

PRINT 

PRINT 

PRINT 

COLOR  14,1 

PRINT* 

PRINT 

PRINT 

COLOR  15,1 

PRINT* 


('At')  is  not  a  choice.  Try  again.' 


Correct.  Let’s  continue.* 


Incorrect.  The  correct  answer  is  B.  The  FAR  provides* 
contracting  officers  with  several  exceptions* 
to  the  general  guidance  that  a  contractor' 
perfore  all  inspections  and  tests.’ 

To  continue,  press  <ENTER>',P 


Nov  let's  turn  froe  our  coeparison  of  individual* 
versus  governeent  perspectives  and  consider  a  scenario' 
where  two  prograa  aanagers  approach  the  inspection' 
requireeents  of  their  respective  programs  differently.’ 


To  continue,  press  <ENTER)',P 


6overneent  Inspection* 


Capt  A  is  the  prograa  aanager  for  an  Electro,  Inc.* 
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5690  PRINT* 
5700  PRINT* 
5710  PRINT* 
5720  PRINT* 
5730  PRINT* 
5740  PRINT* 
5750  PRINT* 
5760  PRINT* 
5770  PRINT* 
5780  PRINT* 
5790  PRINT 
5800  PRINT 
5810  PRINT 
5820  PRINT 
5830  INPUT* 

5840  as 

5850  PRINT 
5860  PRINT 
5870  PRINT 
5880  PRINT 
5890  PRINT* 
5900  PRINT* 
5910  PRINT* 
5920  PRINT* 
5930  PRINT- 
5940  PRINT* 
5950  PRINT* 
5960  PRINT* 
5970  PRINT- 
5980  PRINT- 
5990  PRINT* 
6000  PRINT* 
6010  PRINT- 
6020  PRINT 
6030  PRINT 
6040  PRINT 
6050  PRINT 
6060  PRINT 
6070  INPUT* 

6080  as 

6090  PRINT 
6100  PRINT 
6110  PRINT 
6120  PRINT 
6130  PRINT 
6140  PRINT 
6150  PRINT 
6160  PRINT- 
6170  PRINT* 
6180  PRINT’ 
6190  PRINT- 
6200  PRINT* 


contract.  He  has  conducted  weekly  visits  to  Electro's* 
facility  to  check  progress  on  an  electronic  sensing  device* 
Electro  is  building  for  a  aajor  fighter  acquisition* 
contract.  To  stage  the  activity,  A  typically  calls  his* 
contractor  counterpart  to  arrange  a  eutually  agreeable* 
tiae  for  hia  and  the  rest  of  the  governaent  teaa  to  visit* 
Electro's  local  plant.  An  upcoaing  inspection,  which* 
includes  a  deaonstration  of  device  functions  coapleted  thus* 
far,  as  well  as  a  review  of  Electro's  inspection  associated* 
docuaeotation,  is  scheduled  to  take  no  aore  than  two  hours.' 


To  continue,  press  (ENTER)', P 


Capt  B,  aanaging  an  identical  prograa  at  Electro,' 
handies  his  inspections  differently.  He  visits  the* 

Electro  facility  daily  asking  questions,  aaking* 
suggestions,  and  requesting  special  deaonstrations  of  the* 
device  as  it  develops.  One  day,  while  working  several* 
short  suspenses  for  his  boss,  he  realizes  he  won't  have* 
tiae  to  aake  the  hour-long  drive  to  the  contractor's  plant.* 
Calling  his  counterparts  at  Electro,  he  requests  they  bring* 
the  'evice,  along  with  appropriate  test  equipaent,  to  the* 
ailitary  base  so  he  and  the  rest  of  the  governaent  teaa  can* 
coaplete  their  daily  aonitoring.  This  request  will  cause* 
Electro  to  spend  several  hours  disasseabl ing,  packing,' 
and  reasseabling  the  unit.* 


To  continue,  press  (ENTER)*, P 


Electro  coaplies  and  a  week  later  sends  the’ 
governaent  contracting  officer  a  bill  for  the  inspection* 
conducted  at  the  base.  Further,  an  additional  aaount  is* 
billed  for  what  Electro  ciaias  are  unnecessary  delays  to* 
their  progress  due  to  excessive  oversight  and  inspection  by’ 
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6210  PRINT* 
6220  PRINT* 
6230  PRINT 
6240  PRINT 
6250  PRINT 
6260  PRINT 
6270  PRINT 
6280  PRINT 
6280  PRINT 
6300  PRINT 
6310  INPUT* 

6320  as 
6330  PRINT 
6340  PRINT 
6350  PRINT 
6360  PRINT 
6370  PRINT 
6380  PRINT 
6390  PRINT 
6400  PRINT 
6410  PRINT* 

6420  PRINT* 

6430  PRINT* 

6440  PRINT* 

6450  PRINT* 

6460  PRINT* 

6470  PRINT 
6480  PRINT 
6490  PRINT 
6500  PRINT 
6510  PRINT 
6520  PRINT 
6530  PRINT 
6540  PRINT 
6550  INPUT* 

6560  COLOR  14,1 
6570  CLS 
6580  PRINT 
6590  PRINT 
6600  PRINT* 

6610  PRINT 
6620  PRINT 
6630  COLOR  15,1 
6640  PRINT* 

6650  PRINT* 

6660  PRINT* 

6670  PRINT* 

6680  PRINT* 

6690  PRINT* 

6700  PRINT* 
6710  PRINT* 

6720  PRINT* 


the  governaent.  In  Electro's  estimation,  such  delays  will  * 
cause  thee  to  aiss  their  product  delivery  date  by  one  veek.* 


To  continue,  press  <ENTER>*,P 


This  scenario,  though  soaevhat  simplistic  given  the* 
coaplexities  which  can  surround  a  contract,  does  highlight* 
several  important  concerns  the  governaent  Bust  consider  in' 
the  performance  of  inspections.  These  concerns  are  for* 
the  tiae,  place,  and  cost  of  governaent  inspection.  Let's* 
consider  each  of  these  concerns  separately.* 


To  continue,  press  <ENTER>*,P 


Tiae  of  Inspection* 


The  FAR  states  the  governaent  has  the  right  to  inspect* 
at  all...tiaes,  including  the  period  of  manufacture,  and* 
in  any  event  before  acceptance.  Hovever,  caution  aust* 
be  exercised.  The  governaent  can  be  exposed  to  potential* 
liability  if  it  causes  undue  or  unnecessary  delay  in* 
the  contractor's  perforaance.  Though  ve  don't  knov* 
Electro's  perforaance  history  or  a  myriad  of  other  issues,' 
it's  easy  to  see  that  the  extent  of  Capt  B's  inspection* 
process  could  lead  to  a  delay  dais  by  the  contractor.* 
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6730  PRINT’ 

6740  PRINT* 
6750  PRINT* 

6760  PRINT 
6770  PRINT* 

6780  PRINT* 

6790  PRINT* 

6800  PRINT 
6810  INPUT* 

6820  as 

6830  PRINT 
6840  PRINT 
6850  PRINT 
6860  PRINT 
6870  PRINT 
6880  PRINT 
6890  PRINT 
6900  PRINT* 

6910  PRINT* 

6920  PRINT* 

6930  PRINT* 

6940  PRINT* 

6950  PRINT* 

6960  PRINT* 

6970  PRINT* 

6980  PRINT* 

6990  PRINT 
7000  PRINT 
7010  PRINT 
7020  PRINT 
7030  PRINT 
7040  PRINT 
7050  INPUT* 

7060  COLOR  11,1 
7070  CLS 
7080  PRINT 
7090  COLOR  14,1 
7100  PRINT* 

7110  COLOR  11,1 
7120  PRINT 
7130  PRINT 
7140  PRINT* 

7150  PRINT 
7160  PRINT 
7170  PRINT* 

7180  PRINT 
7190  PRINT 
7200  PRINT" 

7210  PRINT* 

7220  PRINT* 

7230  PRINT 
7240  PRINT 


Fortunately,  the  courts  do  not  consider  all  delays* 
unreasonable;  contractors  eust  anticipate  soee  inspection* 
related  delays  in  preparing  contract  proposals.' 

Also,  while  the  FAR  indicates  inspection  will ,  in* 
general,  take  place  prior  to  governaent  acceptance,  a* 
provision  for  Certificate  of  Conforaance  aay  be  applied.* 

To  continue,  press  <ENTER>‘,P 


Certificate's  of  Conforaance,  offered  by  the* 
contractor  for  acceptance  by  the  governaent  (like  a* 
guarantee  of  quality)  can  be  used  as  the  sole* 
consideration  for  acceptance  and  is  generally  allowed* 
only  in  those  situations  where  either  saall  losses  would* 
be  incurred  or  the  contractor's  reputation  and  past* 
perforaance  warrant  such  an  award.  However,  even  if  this* 
certificate  is  used,  the  governaent  still  reserves  the* 
right  to  inspect.* 


To  continue,  press  (ENTER)', P 


SELF-TEST  QUESTION* 


Coaplete  the  following  stateaent.' 


A  Certificate  of  Conforaance  is  subaitted  by:* 


a.  the  contracting  officer.* 

b.  the  contractor.' 

c.  either  a  or  b,  depending  upon  the  circuastance.' 
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7250  INPUT* 

Select  a,  b,  or  c,  end  press  <ENTER>  *,AI 

7260  IF  A$=*A* 

THEN  7390 

7270  IF  A$=*a* 

THEN  7390 

* 

7280  IF  AI=*B* 

THEN  7360 

7290  IF  At=*b* 

THEN  7360 

7300  IF  At=*C* 

THEN  7390 

♦ 

7310  IF  A$s’c* 

THEN  7390 

7320  PRINT 

7330  PRINT 

7340  PRINT* 

(*A(‘)  is  not  a  choice.  Try  again.* 

7350  60T0  7240 
7360  PRINT 

7370  PRINT* 

Correct.  Let's  continue.* 

7380  GOTO  7430 
7390  PRINT 

7400  PRINT* 

Incorrect.  The  correct  answer  is  B.  The  contractor* 

7410  PRINT* 

subeits  a  Certificate  of  Conforeance  for  the* 

7420  PRINT* 

governeent's  consideration.1 

7430  PRINT 

7440  INPUT* 

To  continue,  press  <ENTER>‘,P 

7450  COLOR  14,1 

7460  CLS 

7470  PRINT 

7480  PRINT 

7490  PRINT* 

Place  of  Inspection* 

7500  PRINT 

7510  PRINT 

7520  COLOR  15, 
7530  PRINT* 

The  FAR  requires  each  contract  to  specify  the  place  or* 

7540  PRINT* 

places  where  the  governeent  reserves  the  right  to  per  fore* 

7550  PRINT* 

inspection.  The  FAR  offers  five  recoeeendations  for  the* 

7560  PRINT* 

location  of  inspections  at  a  specific  source:* 

7570  PRINT 

7580  PRINT* 

1.  if  use  of  any  other  place  would  cause* 

7590  PRINT* 

uneconomical  disassembly  or  destructive  testing,* 

7600  PRINT 

7610  PRINT* 

2.  if  considerable  loss  would  result  from  making  and* 

7620  PRINT* 

shipping  unacceptable  products,* 

7630  PRINT 

7640  PRINT* 

3.  if  special  instruments,  facilities,  etc.,  are* 

7650  PRINT* 

available  only  at  the  source,' 

m 

7660  PRINT 

7670  PRINT 

S 

7680  PRINT 

7690  PRINT 

7700  INPUT* 

To  continue,  press  <ENTER>*,P 

7710  as 

7720  PRINT 

7730  PRINT 

7740  PRINT 

7750  PRINT 

7760  PRINT 
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7770  PRINT 
7780  PRINT 
7790  PRINT 
7800  PRINT1 
7810  PRINT* 
7820  PRINT 
7830  PRINT1 
7840  PRINT1 
7850  PRINT 
7860  PRINT 
7870  PRINT 
7880  PRINT 
7890  PRINT 
7900  PRINT 
7910  PRINT 
7920  PRINT 
7930  PRINT 
7940  INPUT* 

7950  COLOR  14, 1 
7960  CLS 
7970  PRINT 
7980  PRINT 
7990  PRINT 
8000  PRINT 
8010  PRINT 
8020  PRINT 
8030  PRINT1 
8040  PRINT 
8050  PRINT 
8060  COLOR  15,1 
8070  PRINT1 
8080  PRINT1 
8090  PRINT1 
8100  PRINT1 
8110  PRINT- 
8120  PRINT1 
8130  PRINT1 
8140  PRINT 
8150  PRINT 
8160  PRINT 
8170  PRINT 
8180  PRINT 
8190  PRINT 
8200  INPUT1 
8210  CLS 
8220  PRINT 
8230  PRINT 
8240  PRINT 
8250  PRINT 
8260  PRINT 
8270  PRINT1 
8280  PRINT* 


4.  if  government  inspection  during  contract1 
performance  is  deemed  essential,  or* 

5.  if,  for  any  other  reason,  it  is  seen  as  in  the* 
best  interest  of  the  government.1 


To  continue,  press  (ENTER)1, P 


Costs  of  Inspection" 


If  inspection  is  performed  at  the  contractor's  or1 
subcontractor's  premises,  the  contractor  will  provide1 
facilities  and  assistance  vithout  added  charge.  If1 
conducted  at  other  than  contractor  premises,  the* 
government  bears  the  expense.  The  government  also  pays1 
whenever  it  requires  special  inspection  equipment,1 
regardless  of  where  the  activity  occurs.1 


To  continue,  press  (ENTER)1, P 


He  should  remember,  at  this  point,  the  two  purposes’ 
Caot  A  set  out  to  accomplish  with  his  inspection.  Not1 


» 
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8290  PRINT* 

8300  PRINT* 

8310  PRINT* 
8320  PRINT* 

8330  PRINT* 

8340  PRINT* 

8350  PRINT* 

8380  PRINT 
8370  PRINT* 

8380  PRINT 
8390  PRINT 
8400  PRINT 
8410  PRINT 
8420  PRINT 
8430  PRINT 
8440  INPUT* 

8450  CLS 
8460  PRINT 
8470  PRINT 
B480  PRINT 
8490  PRINT 
8500  PRINT 
8510  PRINT 
8520  PRINT* 

8530  PRINT- 
8540  PRINT 
8550  PRINT* 

8560  PRINT 
8570  PRINT* 

8580  PRINT* 

8590  PRINT* 

8600  PRINT- 
8610  PRINT 
8620  PRINT 
8630  PRINT 
8640  PRINT 
8650  PRINT 
8660  PRINT 
8670  PRINT 
8680  INPUT* 
8690  COLOR  11,1 
8700  CLS 
8710  PRINT 
8720  COLOR  14,1 
8730  PRINT- 
8740  COLOR  11,1 
8750  PRINT 
8760  PRINT 
8770  PRINT* 

8780  PRINT 
8790  PRINT 
8800  PRINT* 


only  did  his  teat  witness  a  demonstration  of  the* 
functionality  of  the  device,  they  also  reviewed  Electro's* 
inspection  documentation.  This  review  of  documentation* 
is  in  keeping  with  the  TAR  requirement  which  states  a* 
contractor  shall  provide  and  maintain  an  inspection* 
system  acceptable  to  the  government.  It  further  requires* 
the  contractor  to  do  four  things:* 

1.  control  the  quality  of  its  supplies  and  services,* 


To  continue,  press  <ENTER>*,P 


2.  tender  for  acceptance  only  supplies  and  services* 
which  conform  to  contract  requirements,* 

3.  ensure  vendors  have  adequate  quality  control,  and* 

4.  saintain  records  of  inspection  activities  which* 
evidence  the  fact  that  supplies  and  services' 
conform  to  the  contract,  and  furnish  the* 
government  such  information  as  required.* 


To  continue,  press  <ENTER)',P 


SELF-TEST  QUESTION* 


Indicate  your  answer  to  the  following.' 


The  FAR  specifies  that  a  contractor  must  only  »uo«it* 
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S810 

8820 

8830 

8840 

8850 

8860 

8870 

8880 

88S0 

8900 

8910 

8920 

8930 

8940 

8950 

8960 

8970 

8980 

8990 

9000 

9010 

9020 

9030 

9040 

9050 

9060 

9070 

9080 

9090 

9100 

9110 

9120 

9130 

9140 

9150 

9160 

9170 

9180 

9190 

9200 

9210 

9220 

9230 

9240 

9250 

9260 

9270 

9280 

9290 

9300 

9310 

9320 


PRINT’ 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT 

INPUT* 

IF  Afs*A* 

IF  Al=*a* 

IF  A$s*8* 

IF  A$=*b* 

PRINT 

PRINT 

PRINT* 

GOTO  8860 

PRINT 

PRINT* 

GOTO  9030 

PRINT 

PRINT* 

PRINT* 

PRINT* 

PRINT 

INPUT* 

COLOR  15, 

CLS 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

PRINT 

INPUT* 

COLOR  14, 

CLS 

PRINT 


products  which  confers  to  contract  requireaents.* 

a.  True* 

b.  False* 


Select  a  or  b,  and  press  <ENTER>  *,At 
THEN  8960 
THEN  8960 
THEN  8990 
THEN  8990 


(•At*)  is  not  a  choice.  Try  again.* 


Correct.  Let's  continue.' 


Incorrect.  The  correct  answer  is  A.  The  FAR  aandates* 
that  a  contractor  only  subait  products  which* 
confora  to  the  requireaents  of  the  contract.' 


To  continue,  press  (ENTER)*, P 


Should  a  contractor’s  systea  of  inspection  fail  to* 
screen  defective  iteas  or  practices,  courts  have  ruled* 
the  governaent  has  the  right  to  decline  any  further* 
inspections.  However,  governaent  actions  to  reject  a* 
contractor's  perforaance  aust  follow  specific  guidelines.' 


To  continue,  press  <ENTER)*,P 
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Rejection  of  Goods/Services1 


9330 

PRINT 

9340 

PRINT 

9350 

PRINT 

9360 

PRINT 

9370 

PRINT 

9380 

PRINT* 

9390 

PRINT 

9400 

PRINT 

9410 

COLOR  15,1 

9420 

PRINT* 

9430 

PRINT* 

9440 

PRINT* 

9450 

PRINT* 

9460 

PRINT* 

9470 

PRINT* 

9480 

PRINT- 

9490 

PRINT* 

9500 

PRINT 

9510 

PRINT 

9520 

PRINT 

9530 

PRINT 

9540 

PRINT 

9550 

INPUT* 

9560 

CIS 

9570 

PRINT 

9580 

PRINT 

9590 

PRINT 

9600 

PRINT 

9610 

PRINT 

9620 

PRINT 

9630 

PRINT* 

9640 

PRINT* 

9650 

PRINT* 

9660 

PRINT* 

9670 

PRINT* 

9680 

PRINT* 

9690 

PRINT* 

9700 

PRINT* 

9710 

PRINT* 

9720 

PRINT* 

9730 

PRINT 

9740 

PRINT 

9750 

PRINT 

9760 

PRINT 

9770 

PRINT 

9780 

PRINT 

9790 

INPUT* 

9800 

as 

9810 

PRINT 

9820 

PRINT 

9830 

PRINT 

9840 

PRINT 

Nov  that  we've  established  both  government  and1 
contractor  responsibilities  for  inspections,  let’s  return* 
to  our  prograa  aanagers.  Consider  a  point  in  tine  where* 
each  manager  has  just  coapleted  final  inspection  four  (4)* 
weeks  ahead  of  the  contract  delivery  date.  Unfortunately,* 
both  devices  failed  in  their  ability  to  resist  electronic* 
jaaaing  (interference)  as  required  by  the  governaent* 
developed  and  approved  product  specification.' 


To  continue,  press  <ENTER)*,P 


While  present  at  the  contractor’s  facility  (just  after* 
inspection),  Capt  A  iaaediately  told  Electro  he  intended* 
to  reject  the  device,  citing  the  specification  to  which* 
the  product  did  not  confora.  Since  final  inspection  for’ 
acceptability  had  occurred  ahead  of  schedule,  Electro* 
asked  A’s  permission  to  correct  the  defect  and  retest  for* 
acceptance  no  later  than  the  originally  contracted* 
delivery  date.  Since  the  defect  appeared  repairable* 
within  the  remaining  contract  tiae,  Capt  A  agreed  to* 
Electro’s  request.* 


To  continue,  press  (ENTER)*, P 
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9850  PRINT 
9860  PRINT 
9870  PRINT' 
9880  PRINT* 
9890  PRINT* 
9900  PRINT* 
9910  PRINT* 
9920  PRINT* 
9930  PRINT* 
9940  PRINT* 
9950  PRINT* 
9960  PRINT* 
9970  PRINT 
9980  PRINT 
9990  PRINT 
10000  PRINT 
10010  PRINT 
10020  PRINT 
10030  INPUT- 
10040  CLS 
10050  PRINT 
10060  PRINT 
10070  PRINT 
10080  PRINT 
10090  PRINT 
10100  PRINT 
10110  PRINT 
10120  PRINT* 
10130  PRINT* 
10140  PRINT 
10150  PRINT* 
10160  PRINT* 
10170  PRINT* 
10180  PRINT* 
10190  PRINT 
10200  PRINT 
10210  PRINT 
10220  PRINT 
10230  PRINT 
10240  PRINT 
10250  PRINT 
10260  PRINT 
10270  INPUT* 
10280  CLS 
10290  PRINT 
10300  PRINT 
10310  PRINT 
10320  PRINT 
10330  PRINT 
10340  PRINT* 
10350  PRINT* 
10360  PRINT* 


On  the  other  hand  Ca pt  B,  though  recognizing  the* 
defect,  gave  no  indication  that  the  government  eight  reject* 
the  device.  Instead,  he  asked  Electro  to  transport  the* 
device  out  to  the  base.  There,  Capt  B  intended  to  have  his* 
teas  of  engineers  further  analyze  the  itee  without* 
contractor  interference  to  see  if  the  government  should’ 
consider  accepting  the  item  despite  its  obvious  defect.* 

The  contracted  delivery  date  passed  and  Capt  B  had  still* 
not  communicated  any  sort  of  rejection  to  Electro  for  the* 
nonconforming  product,* 


To  continue,  press  <ENTER)*,P 


Six  (6)  key  points  about  rejecting  defective  supplies* 
or  services  need  to  be  underlined  from  the  above  passages:* 

1.  Nonconformance  most  often  results  in  rejection* 
when  performance,  durability,  operational* 
effectiveness,  appearance,  or  weight  have  been* 
adversely  affected.’ 


To  continue,  press  <ENTER>*,P 


2.  Notice  of  rejection  must  be  given  to  the* 
contractor  within  a  reasonable  time.  However,' 
reasonable  time  can  mean  many  things  and  should  be* 
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* 


10370  PRINT* 
10380  PRINT1 
10390  PRINT* 
10400  PRINT* 
10410  PRINT* 
10420  PRINT* 
10430  PRINT* 
10440  PRINT* 
10450  PRINT 
10460  PRINT 
10470  PRINT 
10480  PRINT 
10490  PRINT 
10500  PRINT 
10510  INPUT* 
10520  CIS 
10530  PRINT 
10540  PRINT 
10550  PRINT 
10560  PRINT 
10570  PRINT 
10580  PRINT 
10590  PRINT* 
10600  PRINT* 
10610  PRINT* 
10620  PRINT 
10630  PRINT* 
10640  PRINT* 
10650  PRINT 
10660  PRINT- 
10670  PRINT 
10680  PRINT* 
10690  PRINT* 
10700  PRINT 
10710  PRINT 
10720  PRINT 
10730  PRINT 
10740  PRINT 
10750  INPUT* 
10760  COLOR  11,1 
10770  CIS 
10780  PRINT 
10790  COLOR  14,1 
10800  PRINT* 
10810  COLOR  11,1 
10820  PRINT 
10830  PRINT 
10840  PRINT* 
10850  PRINT 
10860  PRINT 
10870  PRINT* 
10880  PRINT* 


specified  in  the  contract.  If  not  specified,' 
courts  have  ruled  that  the  government  should* 
infon  the  contractor  of  its  intent  to  reject  the* 
contractor's  product  as  soon  as  the  government* 
makes  such  a  determination.  Otheruise,  as  in* 

Capt  B's  case,  an  implied  acceptance  of  the* 
contractor's  product  can  be  assumed  on  the* 
government's  behalf.' 


To  continue,  press  <ENTER)',P 


3.  Reasons  for  the  government's  rejection  must  be* 
given  to  the  contractor.  This  notice  does  not* 
need  to  be  in  writing  unless--' 

a.  the  rejection  is  communicated  at  a  place* 
other  than  the  contractor's  facilities,' 

b.  contractor  performance  is  inexcusably  late,  or* 

c.  the  contractor  continues  to  submit* 
nonconforming  products.' 


To  continue,  press  <ENTER>*,P 


SELF-TEST  QUESTION* 


Indicate  your  answer  to  the  following.* 


Interfering  with  the  contractor’s  ownership  of  its  product* 
can  be  seen  as  an  implied  acceptance  of  that  product* 
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by  the  governaent. 


10890  PRINT* 
10900  PRINT 
10910  PRINT* 
10920  PRINT* 
10930  PRINT 
10940  PRINT 
10950  INPUT* 
10960  If  A$=*A* 
10970  IF  A»=*a* 
10980  If  A*=*8* 
10990  IF  A$=*b* 
11000  PRINT 
11010  PRINT 
11020  PRINT* 
11030  GOTO  10940 
11040  PRINT 
11050  PRINT* 
11060  60T0  11130 
11070  PRINT 
11080  PRINT* 
11090  PRINT* 
11100  PRINT* 
11110  PRINT* 
11120  PRINT* 
11130  PRINT 
11140  INPUT* 
11150  COLOR  15,1 
11160  CLS 
11170  PRINT 
11180  PRINT 
11190  PRINT 
11200  PRINT 
11210  PRINT 
11220  PRINT 
11230  PRINT- 
11240  PRINT- 
11250  PRINT- 
11260  PRINT* 
11270  PRINT* 
11280  PRINT* 
11290  PRINT* 
11300  PRINT* 
11310  PRINT- 
11320  PRINT- 
11330  PRINT 
11340  PRINT 
11350  PRINT 
11360  PRINT 
11370  PRINT 
11380  INPUT- 
11390  CLS 
11400  PRINT 


a.  True* 

b.  false* 


Select  a  or  b,  and  press  (ENTER)  *,At 
THEN  11040 
THEN  11040 
THEN  11070 
THEN  11070 


(*Af*)  is  not  a  choice.  Try  again.* 


Correct.  Let's  continue.* 


Incorrect.  The  correct  answer  is  A.  Courts  of  law  have- 
ruled  that  governaent  interference  with  a* 
contractor's  ownership  of  (ability  to  control)* 
a  product  can  constitute  an  iaplied  acceptance’ 
of  that  product.* 


To  continue,  press  (ENTER)*, P 


4.  Nuaerous  options  are  available  to  the  governaent  in 
the  event  the  contractor's  product  is  found  to  be* 
defective.  As  seen  above,  if  defects  are  deeaed* 
repairable  within  the  noraal  contract  period,  the* 
governaent  aust  allow  the  contractor  the* 
opportunity  to  oake  such  corrections.  In  addition, 
if  the  contractor  delivers  ahead  of  schedule  and* 
reasonably  believes  the  product  will  be  accepted,' 
it  is  authorized  a  reasonable  aaount  of  tiae* 
beyond  the  delivery  date  to  aake  corrections.' 


To  continue,  press  (ENTER)*, P 


a 


a 


100 


11410 

11420 

11430 

11440 

11450 

11460 

11470 

11480 

11490 

11500 

11510 

11520 

11530 

11540 

11550 

11560 

11570 

11580 

11590 

11600 

11610 

11620 

11630 

11640 

11650 

11660 

11670 

11680 

11690 

11700 

11710 

11720 

11730 

11740 

11750 

11760 

11770 

11780 

11790 

11800 

11810 

11820 

11830 

11840 

11850 

11860 

11870 

11880 

11890 

11900 

11910 

11920 


PRINT 

PRINT 

PRINT- 

PRINT* 

PRINT- 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT 

PRINT* 

PRINT* 

PRINT* 

PRINT* 

PRINT 

PRINT 

PRINT 

INPUT* 

COLOR  11,1 

CLS 

PRINT 

COLOR  14,1 

PRINT* 

COLOR  11,1 

PRINT 

PRINT 

PRINT* 

PRINT 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT* 

PRINT* 

PRINT 

PRINT 

INPUT* 

IF  AI**A* 
IF  A$=*a* 
IF  AI=*B* 
IF  A$=*b* 


5.  If  final  inspection  is  performed  (per  the  contract) 
at  a  government  facility,  government  rejection* 
mould  require  the  contractor  to  remove  the* 
defective  product  unless  authorized  to  complete* 
correct ions-in-pl ace.  If  rejected  items  are  not* 
removed  promptly  the  government  can  terminate  the* 
contract  (unlikely  in  most  situations)  or  remove,* 
replace,  or  repair  the  item  at  the  contractor’s* 
expense.  However,  termination  only  applies  if  the* 
defects  are  judged  not  repairable  within  the* 
delivery  schedule  specified  by  the  contract.' 

6.  Should  the  government  decide  to  accept  defective* 
goods  or  services  (which  it  can  do  in  its  own  best* 
interest),  it  can  require  an  equitable  price* 
reduction  from  the  contractor.* 


To  continue,  press  (ENTER)*, P 


SELF-TEST  BUESTI0N* 


Indicate  your  answer  to  the  following.' 


A  contractor  can  be  authorized  tine  beyond  the  delivery* 
date  to  make  corrections  to  a  product.* 

a.  True* 

b.  False* 


Select  a  or  b,  and  press  (ENTER)  *,A4 
THEN  11900 
THEN  11900 
THEN  11930 
THEN  11930 


a 


PRINT 

PRINT 

PRINT*  CAD  is  not  a  choice.  Try  again.* 

GOTO  11800 

PRINT 

PRINT*  Correct.  Let’s  continue.* 

GOTO  12000 
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11930  PRINT 
11940  PRINT* 
11950  PRINT* 
11960  PRINT* 
11970  PRINT* 
11980  PRINT* 
11990  PRINT* 
12000  PRINT 
12010  INPUT* 
12020  COLOR  15,1 
12030  CLS 
12040  PRINT 
12050  PRINT 
12060  PRINT 
12070  PRINT 
12080  PRINT 
12090  PRINT 
12100  PRINT 
12110  PRINT 
12120  PRINT 
12130  PRINT* 
12140  PRINT* 
12150  PRINT- 
12160  PRINT 
12170  PRINT 
12180  PRINT 
12190  PRINT 
12200  PRINT 
12210  PRINT 
12220  PRINT 
12230  PRINT 
12240  PRINT 
12250  PRINT 
12260  INPUT* 
12270  CIS 
12280  PRINT 
12290  PRINT 
12300  PRINT 
12310  COLOR  14,1 
12320  PRINT- 
12330  COLOR  15,1 
12340  PRINT 
12350  PRINT 
12360  PRINT* 
12370  PRINT* 
12380  PRINT- 
12390  PRINT* 
12400  PRINT* 
12410  PRINT* 
12420  PRINT* 
12430  PRINT* 
12440  PRINT 


Incorrect.  The  correct  answer  is  A.  If  the  contractor* 
delivers  ahead  of  schedule  and  reasonably* 
believes  the  product  will  be  accepted,  yet* 
•inor  defects  are  found,  the  contractor  aust* 
be  authorized  tiee  beyond  the  contract  date* 
to  take  corrections.' 

To  continue,  press  <ENTER>*,P 


So  far  ve  have  only  considered  the  rejection  of  goods* 
or  services.  Let's  consider  the  other  possibility — for ■ 
acceptance  of  the  contractor's  performance.* 


To  continue,  press  (ENTER)*, P 


Acceptance  of  6oods/Services* 


In  general,  government  acceptance  can  occur  before,  at* 
the  tine  of,  or  even  after  deliver  of  the  product.  In' 
addition,  acceptance  can  occur  implicitly,  demonstrated  in* 
our  example  when  Capt  8  failed  to  reject  the  nonconforming* 
electronic  device  within  a  reasonable  tine.  His  actions' 
were  just  as  binding  as  if  he  had  explicitly  accepted  the* 
item  by  forwarding  written  notice  of  that  fact  through  his* 
contracting  officer.* 
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12450  PRINT* 
12460  PRINT* 
12470  PRINT* 
12480  PRINT* 
12490  PRINT 
12500  PRINT 
12510  PRINT 
12520  INPUT* 
12530  CIS 
12540  PRINT 
12550  PRINT 
12560  PRINT 
12570  PRINT* 
12580  PRINT* 
12590  PRINT* 
12600  PRINT* 
12610  PRINT* 
12620  PRINT* 
12630  PRINT* 
12640  PRINT* 
12650  PRINT* 
12660  PRINT- 
12670  PRINT 
12680  PRINT* 
12690  PRINT* 
12700  PRINT* 
12710  PRINT- 
12720  PRINT- 
12730  PRINT 
12740  PRINT 
12750  PRINT 
12760  INPUT* 
12770  CIS 
12780  PRINT 
12790  PRINT 
12800  PRINT 
12810  PRINT 
12820  PRINT 
12830  PRINT 
12840  PRINT 
12850  PRINT* 
12860  PRINT* 
12870  PRINT- 
12880  PRINT* 
12890  PRINT* 
12900  PRINT* 
12910  PRINT* 
12920  PRINT- 
12930  PRINT 
12940  PRINT 
12950  PRINT 
12960  PRINT 


To  suaaarize,  whether  acceptance  is  explicit  or* 
iaplicit,  the  result  is  the  saae:  aside  froa  the  four* 
specific  exceptions  we  are  about  to  consider,  acceptance* 
is  conclusive.* 


To  continue,  press  (ENTER)*, P 


A  contractor  is  not  liable  for  defects  which  the* 
governaent  should  have  discovered  during  the  inspection* 
process.  Such  defects,  called  patent  defects,  often* 
result  when  the  governaent  does  not  exercise  its  right  to* 
inspect.  However,  not  all  defects  are  detectable.  For* 
exaaple,  a  frequent  problea  in  software  acquisitions  is* 
that  while  test  prograas  ensure  all  required  functions  are* 
achievable,  every  conceivable  route  through  software  loops' 
is  not  traversed.  As  a  result,  defects  often  crop  up  after* 
acceptance  when  the  governaent  begins  using  the  product.* 

This  first  exception,  called  a  latent  defect,  reaains* 
hidden  froa  knowledge  and  sight,  and  is  not  found  through* 
reasonable  inspection  or  care.  Unlike  the  patent  defect* 
first  described,  latent  defects  everturn  the  collusiveness* 
of  governaent  acceptance.* 


To  continue,  press  (ENTER)', P 


Another  condition  which  negates  governaent  acceptance* 
is  one  where  a  contractor  deliberately  aisrepresents  (or* 
conceals)  the  facts  with  an  intent  to  aislead,  resulting  in* 
daaages  to  the  governaent.  Such  cases,  called  fraud,  occur* 
infrequently  and  are  extreaely  difficult  to  prove.  Wien* 
the  governaent  has  evidence  of  fraud  it  usually  pursues* 
criainal  as  well  as  civil  actions  against  the  contractor.' 

If  successful,  the  governaent  receives  double  daaages.' 
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12970  MINT 
12980  PRINT 
12990  PRINT 
13000  INPUT* 
13010  CLS 
13020  PRINT 
13030  PRINT 
13040  PRINT 
13050  PRINT 
13080  PRINT 
13070  PRINT* 
13080  PRINT* 
13090  PRINT* 
13100  PRINT* 
13110  PRINT* 
13120  PRINT 
13130  PRINT* 
13140  PRINT* 
13150  PRINT* 
13160  PRINT* 
13170  PRINT* 
13180  PRINT* 
13190  PRINT* 
13200  PRINT 
13210  PRINT 
13220  PRINT 
13230  PRINT 
13240  INPUT- 
13250  CLS 
13260  PRINT 
13270  PRINT 
13280  PRINT 
13290  PRINT 
13300  PRINT 
13310  PRINT 
13320  PRINT 
13330  PRINT 
13340  PRINT* 
13350  PRINT* 
13360  PRINT- 
13370  PRINT* 
13380  PRINT* 
13390  PRINT* 
13400  PRINT 
13410  PRINT 
13420  PRINT 
13430  PRINT 
13440  PRINT 
13450  PRINT 
13460  PRINT 
13470  PRINT 
13480  INPUT* 


To  continue,  press  <ENTER>*,P 


Consider  a  situation  where  a  contractor  incorrectly- 
certified  contr.vt  iteas  as  identical  to  ones  previously* 
[government]  approved.  In  a  siailar  event  another* 
contractor  failed  to  tell  the  governaent  about  a  change* 
in  material  for  a  previously  approved  coaponent.' 

In  both  cases  the  contractor  coaaitted  vhat  looked* 
like  fraud,  but  without  an  intent  to  deliberately  aislead* 
the  governaent.  This  type  of  error  is  called  a* 
gross  aistake  by  the  contractor  and,  like  fraud,  overturns' 
the  collusiveness  of  governaent  acceptance.  However,* 
the  government's  burden  of  proof  for  gross  aistakes,  as* 
well  as  for  fraud  and  latent  defects,  is  significant.* 


To  continue,  press  <ENTER>’,P 


The  final  condition  which  can  overturn  governaent’ 
acceptance  is  when  warranties,  (our  discussion  at  the’ 
beginning  of  this  session),  are  explicitly  provided  for  in* 
the  contract,  As  we  saw  earlier,  warranties  assure  the* 
governaent  has  an  avenue  for  recourse  with  the  contractor* 
after  acceptance  has  occurred.* 


To  continue,  press  (ENTER)', P 


\ 


I 
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SELF-TEST  QUESTION' 


13490  COLOR  11,1 
13500  as 
13510  PRINT 
13520  COLOR  14,1 
13530  PRINT* 

13S40  COLOR  11,1 
13550  PRINT 
13560  PRINT 

13570  PRINT*  Complete  the  following  statement.* 

13580  PRINT 
13590  PRINT 

13600  PRINT*  The  burden  of  proof  for  latency,  fraud,  and  gross  mistakes' 
13610  PRINT*  eistakes:' 

13620  PRINT 
13630  PRINT 

13640  PRINT*  a.  rests  on  the  contractor.’ 

13650  PRINT*  b.  rests  on  the  government.* 

13660  PRINT*  c.  is  the  responsibility  of  a  civil  court  of  lav.* 

13670  PRINT 
13680  PRINT 

13690  INPUT*  Select  a,  b,  or  c,  and  press  (ENTER)  *,Af 

13700  IF  At=*A*  THEN  13830 

13710  IF  A$=*a*  THEN  13830 

13720  IF  AI=*B*  THEN  13800 

13730  IF  A4-*b*  THEN  13800 

13740  IF  AI=*C*  THEN  13830 

13750  IF  A«=*c*  THEN  13830 

13760  PRINT 

13770  PRINT 

13780  PRINT*  (‘AIM  is  not  a  choice.  Try  again.* 

13790  SOTO  13680 
13BOO  PRINT 

13810  PRINT*  Correct.  Let's  continue.* 

13820  SOTO  13870 
13830  PRINT 

13840  PRINT*  Incorrect.  The  correct  answer  is  B.  The  burden  of  proof’ 
13850  PRINT*  in  any  of  these  three  instances  rests  with* 

13860  PRINT*  the  government.* 

13870  PRINT 

13BB0  INPUT*  To  continue,  press  <ENTER)*,P 

13890  COLOR  14,1 

13900  CLS 

13910  PRINT 

13920  PRINT 

13930  PRINT 

13940  PRINT*  Concluding  Remarks' 

13950  PRINT 
13960  PRINT 
13970  COLOR  15,1 

139B0  PRINT*  6iven  the  conclusiveness  of  acceptance  and  the* 

13990  PRINT*  difficulties  the  government  can  have  in  proving  claims* 

14000  PRINT*  against  a  contractor,  it  is  easy  to  see  why  the  government’ 
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14010  PRINT" 
14020  PRINT* 
14030  PRINT* 
14040  PRINT* 
14050  PRINT* 
14060  PRINT* 
14070  PRINT* 
14080  PRINT* 
14090  PRINT* 
14100  PRINT* 
14110  PRINT 
14120  PRINT 
14130  PRINT 
14140  INPUT* 
14150  COLOR  14,1 
14160  CIS 
14170  PRINT 
14180  PRINT* 
14190  PRINT 
14200  PRINT 
14210  COLOR  15,1 
14220  PRINT* 
14230  PRINT* 
14240  PRINT* 
14250  PRINT 
14260  PRINT 
14270  PRINT* 
14280  PRINT 
14290  PRINT* 
14300  PRINT* 
14310  PRINT 
14320  PRINT* 
14330  PRINT* 
14340  PRINT 
14350  PRINT* 
14360  PRINT* 
14370  PRINT 
14380  PRINT* 
14390  PRINT 
14400  END 


places  such  high  priority  on  inspection  prograes.  Further,* 
the  governaent's  reliance  on  inspections  as  the  prieary* 
•eans  of  ensuring  product  quality  has  ainiaized  the  role* 
of  warranties  for  aany  acquisitions.  However,  when  systea* 
coaplexity  or  other  factors  suggest  appreciable  risk,  the* 
governaent  turns  to  warranties  for  continued  assurance  of* 
product  quality  after  acceptance.  These  two  critical* 
aechanisas,  inspection  and  warranty,  are  the  governaent’s* 
tools  for  ensuring  it  receives  what  it  bargains  for  when* 
it  aakes  purchases  under  contractual  agreeaents.' 


To  continue,  press  <ENTER>*,P 


END  OF  LESSON* 


You  have  coapleted  the  coaputerized  text  portion  of 
this  exercise.  Before  proceeding  to  the  quiz,  please  do* 
the  following:' 


1.  Open  the  quiz  envelope  and  reaove  the  quiz.' 

2.  Write  the  elapsed  tiH  shown  on  the  blackboard  on* 
the  cover  of  your  quiz.' 

3.  On  the  coaputer  keyboard,  type  the  word  SYSTEH  and* 
press  the  <ENTER>  key.’ 

4.  Turn  off  your  eonitor  by  depressing  the  0N/0FF* 
button  at  the  front  of  your  color  aonitor.* 

5.  Open  the  quiz  and  answer  the  questions.* 


I 
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Appendix  £_L  End  Qj_  Lesson  Quiz 


DIRECTIONS :  Plesse  circle  the  letter  of  the  response  which 

best  answers  or  completes  the  following 
statements . 

1.  Though  the  terms  in  s  contract  can  specify  otherwise, 
government  acceptance  of  a  contractor's  product  can 
occur : 

a.  prior  to  delivery  of  the  product. 

b.  at  the  time  of  delivery  of  the  product. 

c.  after  delivery  of  the  product. 

d.  all  of  the  above. 

2.  Government  acceptance  of  contractor  products: 

a.  is  not  conclusive  since  the  government  has  the 
discretion  to  return  items  despite  its  earlier 
acceptance . 

b.  is  conclusive,  except  for  patent  defects,  fraud, 
gross  mistakes,  or  warranties. 

c.  is  conclusive,  except  for  latent  defects,  fraud, 
gross  mistakes,  or  warranties. 

d.  is  not  Implied  when  government  use  or  retention  of 
the  product  interferes  with  the  contractor's 
ownership . 

3.  Considering  final  inspection  at  a  government  facility, 
if  a  contractor's  product  is  found  defective  and  is  not 
promptly  removed,  replaced,  or  corrected,  the 
government : 

a.  may  terminate  the  contract  for  default. 

b.  may  remove  or  replace  the  defective  product  at  the 
contractor’s  expense. 

c.  both  a  and  b. 

4.  A  defect  existing  at  the  time  of  the  government's 
acceptance  which  could  have  been  discovered  is  a  latent 
defect . 

a.  True 

b.  False 
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5.  If  the  governaent  elects  to  reject  a  defective  product: 

a.  it  aust  allow  the  contractor  to  correct  that  defect 
if  it  can  be  repaired  within  the  normal  contract 
period . 

b.  it  is  under  no  obligation  to  give  a  contractor  the 
opportunity  to  correct  the  defect. 

c.  it  aust  notify  the  contractor  no  later  than  on  the 
day  of  final  product  delivery. 

6.  In  a  contract  dispute  where  the  governaent  subaits  that 
a  defect  is  latent,  the  contractor  aight  argue  that  the 
defect  is,  instead,  patent. 

a .  True 

b.  False 

7.  The  government's  notice  of  rejection  for  nonconforming 
products  does  not  have  any  specific  format,  but  must 
always  be  in  writing. 

a.  True 

b.  False 

8.  Express  warranties: 

a.  aust  have  their  duration  spelled  out  in  the 
contract . 

b.  are  required  for  contracts  whose  total  costs  exceed 
$1  million. 

c.  need  not  physically  appear  in  the  contract  when  the 
contractor  offers  a  Certificate  of  Conformance. 

9.  Implied  acceptance  by  the  governaent  can  result  when 
timely  notice  of  ■’ejection  is  not  given  to  the 
contractor . 

a.  True 

b.  False 

10.  The  FAR  indicates  that  resources  for  enforcing  a 
warranty  aust  be  considered  in  the  government's 
decision  to  include  an  express  warranty  in  a  contract. 

a.  True 

b.  False 

11.  The  FAR  specifies  that  a  contractor  aust  offer  only 
those  products  which  conform  to  contract  requirements . 

a.  True 

b.  False 
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12.  Since  they  are  not  specifically  referenced  in  a 
contract,  iaplied  warranties  are  not  binding  on  the 
contractor . 

a.  True 

b.  False 

13.  Unless  otherwise  stated  In  the  contract,  when  the 
government  conducts  an  inspection  on  the  previses  of  a 
contractor  or  its  subcontractor,  the  costs  of  the 
inspection  are  borne  by: 

a.  both  the  governaent  and  contractcr,  shared  equally. 

b.  the  contractor  only. 

c.  the  governaent  only. 

14.  The  Unifora  Coaaercial  Code  has  been  applied  to 
governaent  contracts: 

a.  by  Boards  of  Contract  Appeals. 

b.  to  substantiate  iaplied  warranties. 

c.  when  the  governaent  seeks  criminal  charges  against 
a  contractor. 

15.  FAR  recoaaendations  for  choosing  the  place  of 
inspection  include: 

a.  the  aaount  of  inspection  perforaed  to  date. 

b.  the  requirements  for  special  instruaents  available 
only  at  a  specific  location. 

c.  availability  of  governaent  TDY  funds. 

d.  supporting  the  best  interests  of  the  contractor. 

16.  An  exaaple  of  iaplied  warranty  of  merchantability  would 
be : 

a.  the  use  of  a  aicrowave  oven  to  wara  food. 

b.  the  use  of  a  ticket  to  reserve  a  particular  seat 
assignment  at  a  Cincinnati  Reds  baseball  gaae. 

c.  neither  a  or  b. 

d.  both  a  and  b. 

17.  A  Certificate  of  Conforaance  is  subaitted  by  the 
contractor  to  the  governaent: 

a.  to  docuaent  the  governaent1*  acceptance  at  a  final 
inspection . 

b.  when  saall  losses  would  be  Incurred  if  the  product 
should  prove  to  be  defective. 

c.  when  costs  are  below  a  threshold  established  by  the 
FAS. 

d.  none  of  the  above. 
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18.  The  implied  warranty  of  fitness  for  a  particular 
purpose  may  be  excluded  from  the  contract  either  orally 
or  in  writing. 

a.  True 

b.  False 

19.  Exceptions  to  the  FAR  requirement  that  the  contractor 
perform  all  inspections  and  tests  are  approved  by: 

a.  the  government  project  manager. 

b.  the  contractor's  program  office. 

c.  the  government  contracting  officer. 

20.  When  a  contractor  defaults  on  a  warranty,  the  decision 
to  accept  an  equitable  price  reduction  rests  with: 

a.  the  government  contracting  officer. 

b.  the  Boards  of  Contract  Appeals. 

c.  the  government  project  manager. 
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Appendix  C_L 


Part  4.  Please  circle  the  appropriate  response  or  fill  in 
the  blank  as  required. 

AGE:  24  to  29 

30  to  35 
36  to  40 
41  to  45 
other : _ 

SEX:  Hale  or  Female 

EXPERIENCE:  Please  indicate  your  current  AFSC: _ 


Part  fL-  Please  use  the  five  point  Likert  scale  provided 
below  to  evaluate  the  following  statements. 

5  Strongly  Agree 
4  Somewhat  Agree 
3  Neutral 

2  Somewhat  Disagree 
1  Strongly  Disagree 

(♦>  (- 


a.  The  structure  of  the  program  would 

be  Improved  if  the  concepts  or  topics 

were  presented  in  reverse  order .  5  4  3  2  1 

b.  The  program  made  it  easy  for  me 
to  distinguish  main  points  from 

supporting  details .  5  4  3  2  1 

c.  The  organization  of  the  lesson 

prepared  me  to  answer  the  quiz .  5  4  3  2  1 

d.  I  could  anticipate  topics  or  concepts 

as  I  progressed  through  the  lesson .  5  4  3  2  1 


e.  The  structure  and  order  of  presentation 

made  it  easy  to  learn  the  text  material.  54321 

f.  The  content  of  this  course  applies 


to  my  future  career  field .  5  4  3  2  1 

g.  Concepts  were  appropriately  defined  when 

they  were  introduced  in  the  lesson .  5  4  3  2  1 

h.  Using  questions  in  the  text  is  an  aid 

to  learning .  5  4  3  2  1 
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(+)  (-) 

i.  The  lesson's  instructions  were  easy 

to  understand  and  execute .  5 

j .  Concepts  were  covered  with  the 

appropriate  level  of  detail .  5 

k.  If  you  answered  1  or  2  to  the  previous 
itea,  please  specify  areas  of  inadequate 
detail  in  the  space  below. 


1.  The  end  of  lesson  quiz  was  clear 
in  both  the  questions  asked  and 

and  responses  provided .  5  4  3  2  1 

a.  I  would  welcoae  taking  another 

CBI  lesson  like  this  one .  5  4  3  2  1 

n.  In  general,  CBI  is  a  good  aethod  for 

presenting  learning  aaterial .  5  4  3  2  1 

o.  I  would  have  learned  the  aaterial 
in  this  lesson  better  froa  a 

paper  copy .  5  4  3  2  1 

p.  Visually,  the  screens  were  attractive 

and  uncluttered .  5  4  3  2  1 

q.  Visually,  the  screens  were 

easy  to  read .  5  4  3  2  1 


r.  If  you  answered  1  or  2  to  the  previous  itea, 
please  indicate  why  in  the  space  below. 


t 
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Appendix  LL  C-gllSfit-A  1 2_  the  Attitude  Survey 


Participant  coaaents  to  the  attitude  survey  are  provided 
below.  The  survey  stateaents  requesting  these  coaaents,  as 
well  as  the  scored  stateaents  preceding  thea,  are  provided 
to  assist  the  reader  in  putting  the  responses  in  the 
appropriate  context. 

Response  At :fil  L 

Survey  Itea  j:  Concepts  were  covered  with  the  appropriate 

level  of  detail. 

Survey  Itea  k:  If  you  answered  1  or  2  to  the  previous  itea, 

please  specify  areas  of  inadequate  detail  in 
the  space  below. 

Participant  Responses  to  Itea  k: 

1.  Too  auch  lnforaation  in  each  paragraph.  Long 
paragraphs  aade  reading  hard  and  retention  difficult  unless 
one  reread  the  entire  paragraph  or  portions  of  it. 

2.  I  probably  could  not  anticipate  topics  or  concepts 
because  the  subject  is  not  familiar  to  ae . 


Rggpppgg  Area  2. 

Survey  Itea  q:  Visually,  screens  were  easy  to  read. 

Survey  Itea  r:  If  you  answered  1  or  2  to  the  previous  itea, 

please  Indicate  why  in  the  space  below. 

Participant  Responses  to  Itea  r: 

1.  Reading  off  a  computer  screen  has  no  advantage  over 
reading  off  a  piece  of  paper.  In  fact,  there  was  little  or 
no  ability  to  back-track  if  you  didn't  understand  something. 
Taking  advantage  of  a  computer's  ability  to  present  graphics 
would  have  helped. 

2.  Paper  copy  allows  for  rereading  if  necessary.  Use 
of  only  one  paragraph  or  a  list  definitely  aade  it  easier 
and  not  intimidating  (l.e.,  seeing  a  screenful). 

3.  Provide  facility  to  back-up  in  lesson  to  review 
previous  aaterlal  (i.e.,  back-page).  It  would  sake  the  aain 
points  stand  out  aore  to  put  thea  in  a  different  color. 
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